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The Social Science Observation Record (SSOR) is a 
systematic observation system designed to abstract and describe class 
discussion, specifically those discussions directed toward value 
clarification as an aspect of subject-matter instruction. The 
objective and yet diverse nature o category observation systems is 
described and an explanation is synthesized of how pre-service and 
in-service teachers may use category observational systems to study 
their behavior as teachers. A model of class discussion relevant to 
student understanding and to value clarification is presented and 
specific categories are identified and described of student and 
teacher behaviors through which student understanding and value 
clarification behaviors can be planned for and employed during class 
discussion. The knowledge and skills necessary for teachers to 
organize and interpret the data are discussed. Empirical studies are 
reported with regard to the modification of teacher and student 
behaviors, and methods by which observers have been trained to 
collect data with reliability using the SSOR are described, 
(Author/PC) 
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PRJEFACE 

Every teacher has experienced the frustration of having had a 
carefully planned classrocn discussion session fail to yield the out- 
cones he desired, and of not knowing exactly what "went wrong." Mthough 
group discussion is used more than any other instructional process in 
eletnentary and secondary classroons, many teachers have difficulty in 
identifying the elements which oontribute to the success or failure of 
their class discussicns. These teachers have not found an adequate 
vehicle for helping thanselves analyze exactly what occurs in a group 
discussion. Consequently, tliey are unable to obtain the data they need 
in order to use the discussion process \d.tli increasing effectiveness. 
The studies described in tMs monograph focuses upon this problem, 

Ihe SSOR is the product of five years developnent and testing. It 
is a systtimatic observation instrument useful to baachers in planning, 
inplementing, and analyzing classroon verbal and non-verbal behaviors. 
The seventeen categories and acocrpanying definitiors describe behaviors 
directed toward values clarification as well as subject-matter 
instruction. Thus, it describes classrocin behaviors associated with intellec- 
tual operations associated with both the cognitive ard affective dcmains. 

Findings of the studies based on use of the instrument indicate 
that: 

1. Verbal and non-verbal behaviors identified by the instrument 
accurately categorize wliat occurs during classroom discussions, 

2. Teachers who knew the instrument can modify their planning for 
discussion in terms of categories of statements they want to hear, 
can shape their teacher-questioning behaviors in directions they 
perceive as desirable. 

3. Teachers who receive feedback data in terns of the s^'stem express 
• positive feelings about their experience. 

4. People wanting to knew the systesn can become reliable observers 
with less than 18 hxDurs of training. 

Er|c iii 



p. K. Ycange Laboratory School is in a position to offer workshops 
presenting the system and providing practice in its application. Wbrk- 
shops can be made available to instructional leaders for use in their 
vrork with teachers. Ideally, workshops can be offered to groups of 
tt.'achers interested in refining their skills in the area of verbal and 
non-verbal interaction. Wbrkshops can also be provided for individu£ds 
desiring to learn the system for research purposes. If interested in 
sponsoring or attending a workshop, please contact either of the 
authors oi- me. 

Dr. J, B. Hodges, Director 
Professor of E)ducation 
P. K. Yonge Laboratory School 
College of Education 
university of Florida 
Gainesville, Florida 32611 
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Chapter I 



AN OVERVIEW AND OASSRDCM IMPLICmONS 

An Introduction 

Classrcm teachers are familiar with observation inatnaiBnts desigoed to 
"rate" them as teachers. Ibey have had eocperienoe, iar exanple, with ratiiig 
instruments as these are often used for purposes of annual faculty evalua- 
tions. Rating scales tend to be loosely defined, high inference instrvanents 
whose users may not be adequately trained to collect data. The use of such 
instrumDnts by s>j±;jecti.ve b.it influential observers has aroused legitimate 
oonoem that data so obtained lack sufficient objectivity to te of vadue 
fcut, nevertlieless, carry adequate professional weight to be personaliy 
threatening to the classrocm teacher. Ambiguous rating scales containing 
numercus high inference categories that cannot be used reliably are not 
to be confused with systematic observation instruments (Rosenshine, 1970b) . 

Si^'stematic observation instruments are also referred to as category 
systems. Category systems enable those trained in their use to collect ob- 
jecti^^ data and to study instructional behavior analytically. Category in- 
strxnents are designed to be descriptive, non-evaluative, and objective 
(Medley and Mitzel, 1963; Simon and Boyer, 1970), This moncgra^^ presents 
one such category instrument— tl-ie Social Scierx:e Observation Itecord (SSOR) . 
More specifically the purposes of this monograp*! are: 

1) To describe the objective and yet diverse nature of category 
observation systems, 

2) Tto synthesize an explanation of hw pre-service and in-service 
teachers may use category observatic^ial systems to study their 
behavior as teachers, 
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3) To present a model of class discussion relevant to studciit 
understanding and to value clarification, 

4) To idertify and describe specific categories of stident and 
teachei behaviors through which student under stc,- ding and 
value clarification behaviors can be planned for and employed 
during class discussion, 

5) To develop the knowledge and skills necess2ry for teachers to 
organize and interpret data, 

6) 'I\:> report anpiricai studies with regard to modification of 
teacher and student behaviors, and 

7) To describe ho-v observers have been traiiied to collect data 
with reliability using the Social Science Observation Record 
(SSOR) systaxi. 

Objectives 1 and 2 are pursued in the remainder of this chapter. Objectives 
3 and 4 are the focus of Chapter II, and objective 5 of Chapter III. 
Pilot empirical studies are reported in Chapter IV. Finally, two between- 
observer reliability studies are reported in Chapter V, 
Observation Systems in Historical Perspective 

Historically, those who have constructed observation instrviments have 
sought to devise means for collecting aipirical data descriptive of what 
occurs in the classroom (Rosenshine and Furst, 1973; Medley and Mitzel, 1963) . 
Pursuant to this goal, instruments intended to describe the verbal, non- 
verbal, climatic, logical, cognitive, affective, and managerial dimensions of 
the classroom have been devised (Simon and Boyer, 1970; Itosenshine, 1970a; 
Rosenshine and Furst, 1973) . Generally, relationships between students and 
their teachers within the classroom environment have h&'n eirphasized. Typi- 
cally, these student-teacher relationships have been broken down analytically 
ijito elements believed to be variables which influence stiKlent learning (Flanders, 
1965; Morino et al., 1971; Amidon an:! Flarders, 1967a), Ihese elements 

-2- 
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wt^en uk^ntifial, (h^f \v<x\, .irirl onjanized, l^ve l>jcaiie catxv/.ry observation 
systt.jns by «]^' rij^ive data riro colloctcxi, orcjaniznd, stx>red,aiid 

canaiy/.od {ilir^tm ami Boyor, 1970; Roseiishine and Furst, 1973). The central 
ty\rust of these efforts lias Ixx^n to describe classroom events b/ isolating 
variables in tix: form or categories t^hat are used in order to analyze 
t.»acher IHvivior is it relates to student learning (Flanders, 19^i5; Medley 
ind Mi',zel, 1963; Suron ai^l Payor, 1970; itosenshine, 1970b; Posfinshine and 
r\irst, 1973) • 

VVlv-rt?as tile deve loiters of observation instruments rave consistently 
vtliKxi objective data collection as a tool for tlie aivalysis of sbjdent- 
f_c^aci,cr intoraction, diff(a>-»nt interests, alternative objectives, conflict- 
ing .V >nvic7l:ims, ard caTij.x?tiiig beliefs as to wiiat variables are iT>ost critical 
tc :>tudoxit leamuig have e^-^entuated in an equally divergent ocl lection of 
i:u-;t nunt^jnts. (For an ovojr\a.ew of seventy-nmc of tl-iese systems, see Mirrors 
of Betu viors [Siirxm am f3<;yer, 1967, 1970].) Son^e ixistruiTKtnts identify f"ictors 
assoc:iat^ii with ciair'.sroorr. climate (Witiiall, 1951; Ajnidon and liough, 1367) . 
Sane stress indirc\:t and direct catecjories of teacher belvaviors (Flanders, 
]'"'60). Some? stiv.^ss student and t*.o:'her cognitive behaviors (Brawn et al., 
1967; Siratii aixi Moux, 1970) . Othrr systoiis focus on student tehaviors asso- 
."latci: v.'iU) t.h.o F^r.ady of s^;'::al i.r.suos aiid the analysis of :riijl:c policies 
ly.jssialas, 1^:^69; Oliver .iiiii ..:viV*M , i'i6C; . Still otriers siAC^fy additional 
'.T^ r Vises m u-rms sach : .v:tois as ^^jni^^nt fi'.ld (Dciliick ot al,, 196»Vi , 
^jcjrutiV'. : r >ci.;-v. -K :S:\:'.:. aji: 1970;, .ird 'yjac'r.or -.x^x^r ur::-.*:.-;] isr^i 

(Rro\vr,, 10"8). iirmcL', a vari-tv ^: sy.sur..'' arc availaijle for cfjll(x:tLng 
L/^;'::*-'"' 'iiita ^'lix/i*: :! roan :x-h.iVior. 
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Many category systems are designed solely to describe the verbal 
interaction of students and teachers under classrocm or micro-teaching 
simulation conditions. Systens stressing verbal behaviors are referred to 
as verbal interaction observation systems. The Social Science Observation 
Record (SSOR) is a verbal interaction observation system. 

Developers 'of interaction cbservation systems have used predetermined 
and carefully defined categories of verbal and nonverbal behaviors to 
describe teacher and student verbal behaviors. TO the degree that the 
data collected are descriptive of classrocm behavior, yihat has been 
observed may be reconstructed and analyzed; hence, tJiese systems are sonetines 
refererred to as "mirrors" of behavior (Simon and Boyer, 1970) , The 
accuracy with which data reflect classrocm events is limited by the 
number of categories incorporated into the observation system;by the skill 
of observers who collect data? by the conceptual tools available for 
reoanstructing,. interpreting and analyzing the data; and by the adequacy 
of the categories as descriptBl of observed behaviors. The Social 
Science Observation Record contains seventeen verbal and non-verbal categories 
serving as descriptors of observable classroom behaviors. Ihe system 
also provides mechanisms by which the data may be reconstructed or "stored" 
for analysis and interpretation. 

Interaction observation instruments are intended to collect empirical 
data systematically. The accuracy with which an observer can collect data 
and the degree to which the meaning of categories can be comunicated are 
critical factors within these stystems. Category systems are characterized 
by precisely defined categories. This precision reduces the need for coders 
to infer, and thereby frees them from the necessity of deciding which 
category to assign to classrocm events. 



'n»c?so lii-'f im Morui also enaiAe tl-Kjso who /jww than to canra.L:iicate wi' 
or» another. Ihus, dbservers can prov.ixie cliissroar; teachers with 
reality data by which they may Intexpret and make decisicris about 
their behavior in the classroan. 

Ihe descri£jtive nature of interaction observation systenis is to 
be contrasted with the evalua'dive nature of rating systems. One of 
thie priiTiary purposes of a rating systen is to evaluate or "grade" a 
behavior or the person deemed responsible for the behavior (Ramers, 
1963) . The primary function of descriptive systems is to collect 
accurate, objective data for subsequent analysis. TYioae who have de- 
signed category systeins relevant to interaction ajialysis have con- 
stn>cted and reoannended ther\ in terms of theix 'iiescriptive and 
analytical pcwar. The Social Science Observat ion Kecord was de-- 
veloped as a descriptive instrtsnent. 

Classroan interaction observation instrumRnts consistently focus 
on one or more of Ihe following: student cognitive behavior, student 
affective behavior, and student or teacher managerial behavior 

(Simon and Boyer, 1970) . Silence or both silence and confusion are 
frequently added to these systen\s as catchalls for all the bdiaviors 
which do not fit the other categories in the systesn. Cognitive 
category systems tend to stress such student behaviors as recall, 
defining, inferring, interpreting, applying, opining, and evaluating 

(Sitcn and Boyer, 1970) . Affective category systems tend to stress 
student feelings and emotions and such factors as teacher warmth. 

(SiTon and Boyer, 1970) . Category systems emphasizing control or 
ranagorent tend to be keyed to lecturing and disciplining as 

teacher behaviors (Rosenshine and Furst, 1973; Smon and Boyer, 1970) 
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SaiK* instruiriCi^ts ojubrace teacher Ixihaviors and student affective [xtr- 
fornances (Aschner et al,, 1967; F\iller, 1970). At least one instrument 
used categories designed to collect data relevant to affective behaviors 
such as awareness, responding, affirming, and valuing as studejit behaviors 
(Kaplan, 1970) . Others incorporate teacher and student cognitive per-- 
fonuances (Bravn, 1968; Brown et al*, 1967; Massialas, 1969) • The SSOR con 
tains categories of behaviors which have been associated with the cognitive 
aff'^?ctivo, and control dimcHisions of tlie classroom. Therefore, the 
Social Science Observation Record incorporates categories relevant to 
student under stand jjig, valuing, and feeling, and to teacher control and 
managGn>e)it as well as non-verbal behavior in the classroom. 

Interaction analysis systems can be learned by classroom teachers, 
super^/isors, and other educational personnel. Learning may be defined as 
uixier standing the categories of a system • Learning may be defined as the 
ability to understand and interpret data as it is explained by a trained 
analyst. Learning may be defined as the ability of a teacher to organize 
his own data for his own interpretive purposes. Learning iray be defined 
to include the ability to code data reliably for one's own use. The SSOR 
has been taught and learned in each of the senses mentioned above. No 
matter what level of learning is achieved, there is evidence to suggest 
that the classroom teacher who ''learns" an observation system is more 
effective than one who does not (Soar, 1968) . 
Sunmary 

Category .systems arc- instrjmenth* designed to collect data relevant 
trj thtj i-X'^iiVior of toachor.-: ^nd stridents in thj classroom. Interaction 
obs*' ,^rvat ion :^;ystems coJlrxrt sarr-los of classroom beiiavior in terms of 



the categories tlney include, Ihese sanples of behavior can be sU>- 
jected to analysis and interpretation. Ttieee systane are developed 
for purposes of oollecting cbjective data and are not recconended as 
evaluative devices. Inbaraction analysis systene stress divergent 
aspects of classnxm bd:>avior. Classroom teachers can learn db- 
servation systems for use as consumers, interpreters, or collectors 
of data. To the degree that a category system reflects the in- 
structional goals of the teacher, that syston possesses value and 
validity for instructional decision making by the teacher. 
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Chapter II 

no:: Six:iM. scienc: obsl:!<^/a?ijn record: 

A DlSCUSSia.^ fODEL 

An Introduction 

The Social Science Observation Record (SSOR) is a systematic 

observation system designed to abstract and describe class dis- 
cussion. The system was conceived and constructed as a theoretical 
model for planning ai>d guiding classrocm discussions, specifically 
those discussicais directed toward value clarification as an aspect 
of subject-matter instruction. Use of the model increases pre- 
cision in planning and provides means by which teachers can guide 
class discussion systematically. The concepts and ideas presented 
in this chapter focus on these applications of this theoretical 
irodel. 

For the classrocm teacher to use the Social Science Observa- 
tion Record as a modal for discussion, he need not be a trained 
analyst. Clioe he is familiar with the oonpOTents of this 
theoretical system, he can apply his kncwledge as he plans, organizes, 
and leads class discussions, -^splication increases the number of 
instructional moves he makes and, consequentially, the range of 
behaviors his students practice. He beocmes more alert to v*iat 
students are saying during class discussions and, consequent i a1 ly , 
responds to and guides their behaviors more accurately and purpose- 
fully. He c^Jerationalizes instructional theories associated with 
student understanding and value clarification on the basis of 
specific and observable student verbal behaviors and, accordingly, 
explores new dimensions of studerit behavior toward which he plax\s 
and teaches. Having acquired facility in applying the SSOR as a 
model for classroori discussion, he can better coiprehend how a 
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trained coder caollects, organizes, and interparets data relevant 
to him as a classroom taeicher. 

The Social Science Cbeervation Iteoord as originally C50n- 
ceptualized vsB3,and oontinues to provide thoee who understand it 
witJv a model for class discussion. In the picooess of learning to 
apply the model, it is necessary, first, to define class dis- 
cu ssion as conoeptueLLized within this fraBnework. Jtooordingly, 
when the gerjeric tem class discussion is used in connection with 
the SSOR, the following is meant; 

. . .At least sixty^f ive percent (65%) of tte 
behavior is recorded as student, teacher, 
or as both student and teacher talk. 

...At least ten percent (10%) of the brfavior 
oocurring is student talk. The teacher 
need not talk for a class discussion to 
occur. 

Class discus sion as a generic form of activity may assime different 

forms within these relevant attributes. Ihe following are adequate 

for subsequent discussions of the SSGR: 

C^n discussion. At least sixty percent (60%) of the 
beha\aor occurring is ooded as student verbal be- 
havior. No more than forty percaent (40%) of the be- 
havior ooded is teacher vezbal behavior. 

Guided discussion . At least forty percent (40%) 
of ttie behavior occurring is ooded as student verfaed 
behavior. No more than sixty percent (60%) of the 
behavior coded is tearher vezhal behavior. 

Directed discussion. At least twenty percent (20%) 
of the behavior occurring is ooded as student verbal 
behavior. No mare than eighty percent (80%) of the 
behavior ooded is teacher verbal behavior. 

Lecture discussion . At least ten percent (10%) of the 
behavior occurring is ooded as student verbal be- 
havior. At least sixty percent (60%) of the be- 
havior oocurring is ooded as teacher verbal behavior. 



By erploying these definitions in cxjnjunction with an understanding of the 
SSOR, teachers, teacher educators, and analysts can convey irore clearly and 
precisely their intended meaning v^ien the term class discussion is their 
referent. When the term class discussion is used in the sections which 
follc^^^, the first definition is meant; v*ien the intent is to address atten- 
tion to a specific form of class discussion the adjectives open, guided , 
direct ed, and lecture will so signify. 

The Social Science Observation Record is framed by categories of behavior 
associated with class discussion and organized into four realms of inquiry. 
Definitions and explanations of the realms of their seventeen categories 
follow: 

Realms of the Social Science Observation Record 

The four realms of the SSCX^ — Subject Centered , Iteacher Centered , 
Man Centered , and Non-Verbal — are also referred to by Rorian numerals. 

Realm I — Subject-Centered 

Realm II — Teacher-Centered 

Recdm III — Man-Centered 

Realm IV — Non-Verbal 
In order to examine hew these four realms are used as ocrpDnents within the 
system, each will be defined in light of its function as an aspect of class 
discussion. 

Realm I — Subject Centered 

The Subject-Centered Realm emphasizes student understanding of the content 
of instruction. Mere specifically it focusses upon the formal content of liu^jject 
matter learning as such learning occurs according bo the rules of disciplined 
kncwing, a characteristic of acquiring a body of knowledge that can be associated 
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with rK'.vlGnic disc-ipllnes. Stulcnt daronstration of this acquisition 
n'proscnts the minimi objectives any teacher rnay logically ai^ ethically 
specify for his stidents. 

Three major student bel^iaviors may be interpreted as irrlicatjons of 
understand ing of concepts. First, stijdents learn and recall content in 
the form of data, ideas, opinions, and beliefs. Although recall is in- 
si.ifficiont in .mi of its<?lf for ixjJ^varring that understandinq has occuri-od; 
;x'V. rUK-'lo.'^s, it recall K'hirh i-iiablos -jvudents to acciiiire lyc^ iinder- 
st-,ut.Mni-is. rH>-'Of\Hy, stuienls insi'jf; nvit'iincJ to the data, ixleas, opinions, 

L*»l U'lici.'. rotri, vAi throKjh r^v.Tl i, th'-s f^^rrxpnal i : ^ijY-i the kn--vlf\igr- Hiey 
"^t'vl 'nti ' -^L^rtL/nin.-- ■ i i" v^i rovjiing 1o rc-.-al i <i:i in- 

• id- : .-A ..'iOy t^iV'~: .iv.iv., i ro-'. scr.i' i.'; • i.f andersi irri inn , "il^ls .^i ^-^i .-.r . -r^t 

-rnv b>\ ()fto:i is, a .^ -t i-i<,-»kil u.xicrsbindiiKr !ji ; i.jht of i\vj 
•;■+;•••■•! .:; ' ,- ;..!ro a.xi scxrio'y. Tl.i:. i.^ n<'7t nficcss-'U") 1 v in 'n-YkrBtaryii'-it} 
Vvl;; v-|,nai- -.v.A.ltyi'KAil-MO v.':" '_h ; f<i..ii\"I 'i" ij^lI^j^-vL-iluf (x^- eContent would 

^'LT^^ vx-ept. il lo . A thini step !> lps .7.v/ra:»ne this e'/entual ity . During tlte. 
third prvise, students identify and dt-fme terrrs aixl concepts v^iich mr^y be 
used as instr.imf^nts for imposincj learned opinicxis on knowledge as it is 
acquired and recalled. Thus, defirong {i-cnd poi'ticularly the defining of 
interpretive concepts) is an essential process in seeking understanding. 
These Uiree dimensions of understanding — recall, personalization, and de- 
fining — are incorporated into the SSOR and assigned to the Subject -Centered 
Realm. 

Identifying concrete exairples of student verbal behaviors will indicate 
the nature and extent of acquisitions vvi.thin tiy? Subject -Centered Realrrt. 
I'.hen stidejits ar-- developing under stand Lnc:, th.ey refer to the focus of stiriy. 



They coipax-e cird contrast ideas, data, and relationships. They identify 
and define new v^rds gemane to the new knowledge they are gathering or 
interpreting or to the discussion in which they are engaged. They organize, 
structure, and elaborate on ideas which enable them to express and share 
their interpretations and perceptions of the oontent being learned. They 
clarify and elaborate what they knew, believe, and think. Each of these 
behaviors are exanples of verbal behaviors assigned to the Subject-Centered 
Realm of the SSOR. 

When the goal of instruction is one of helping students to learn and 
understand oontent, the Subject-Centered Realm beocnes a major focus of 
instruction. When data collected using the Social Science Observation 
Record cluster in the Subject-Centered Realm in patterns describing stu- 
dents who are gather iixj and interpreting data according to defined concepts, 
one may infer that students are engaged in acjquiring knowledge, inposing 
personal meaning on the kncwledge learned, and deriving interpretations 
from the instrumental use of concepts. Using teacher-centered behaviors, 
the teacher structures learning contexts and stinulates student behaviors 
vtiich influence hew students proceed in the Subject-Centered Realm. 
Realm II — Teacher«Centered 

Itie Iteacher-Centered Realm is associated with those verbal behaviors 
ty which teachers organize and manage discussion activities. When the 
teacher cpts to use class discussion as an instructional approach, he 
frequently initiates the activity, provides directions, reacts to student 
verbal and nori-verbal behaviors, responds to ideas and questions of students, 
and culminates the discussion activity. In effect, the te/^clier organizes, 
manages, guides, and ultimately controls the verbal perforranco of stixients. 
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All vcrbtU bt»haviors exhibited by the teacher durinq a class discussion 
.uTCi ccxied as instances of the Toacher-CentXired Rcjaln. 

As the tcadier organizes, manages, guides, and controls class dis- 
cussions he responds to his students and to the instructional situation 
itself in a variety of predictable ways. He presents instructional sit- 
uations within which he expects students to follow directions or respond 
to questions. He sismiarizes what manbers of a discussion group have 
acccinplished , points out the strengths of their performance, indicates 
fallacies or lack of clarity in statements, and notes limitations in under- 
standings. He reacts to student behavior in a variety of ways: (1) by 
criticizing ideas as wrong, inappropriate, or possessing weaknesses,- (2) 
by cain^ending ideas as useful, correct, or wDrthy of investigation; (3) 
by indicating that expressions are not clear; and (4) by suggesting that 
ideas and beliefs may be in::onsistent with me another. Each of these 
behaviors are catagorized in Realm II. All are vrays initiating and 
responding to student verbal and non-verbal behaviors. 

As the classroom teaclier develops his understa'^ing of the Social 
Science Observation Record, he plans and monitors various aspects of his 
own verbal perfonnance. By way of illustration , the teacher considers 
hov; he elicits student behaviors; hew much time he spends organizing, 
managing, guiding, and controlling the disci'ssions; how students react to 
his verbal performance; hew and to v;hat extent he structures verbal be- 
haviors; and what kinds of student behaviors he values. If provided with 
reliable data collected by a traijied coder, he can assess his behavior 
as teacher on the basis of his irpact on student perijormance. VJhen the 
teacher acts as leader of class discussion, he performs most of the l-'^adership 
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functions Incorporated in Realm II. Students also use this realm. 
Students ask questions. Students report that they do not understand 
ideas expressed by other students or by the teacher and request clarifi- 
cation. They criticize and reinforce the ideas of other students. When 
students engage in any of these behaviors, they are coded as behaviors in 
the Teacher -Centered Realm. 

Ihe primry function of Realm II is to facilitate student verbal be- 
havior in Realms I and III. If the instructional objectives being pursued 
are related to student understanding, the teacher uses Realm II in eliciting, 
guiding, and reacting to student behaviors in the Subject-Centered Realm. 
If the teacher's instructional objectives are related to the clarification 
of student values, he uses teacher-centered behaviors to evoke student be- 
haviors in the Man-Centered Realm. 
Realm III — Man»Centered 

The Man-Centered Realm stresses verbal behaviors in vtiich students 
engage in order to clarify their values and feelings. As with understanding, 
value clarification is one of the major goals of formal education. 

If one views schooling as those experiences designed to prepare students 
to cope with and mo-Jify the world in which they live, then they must learn 
disciplined w? /s of engaging in conflict resolution, acMeving rational con- 
sensus, and pursuing their personal welfare as members of a civil society. 
Students are encouraged to perceive the following: 

Logical kncwlodge and rules of knowing, thinking, and acting 
may be made relevant to their experiences. 

Kncwlodqe gained experimentally and accepted on the basis of 
probability may be used to shape thnir puJ^lic and private worlds. 

Kncwlodge of the natural and historical contexts within v*iich 
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events cxxjur ir^r/ Irr; r\ade rolevant to thf; decisions .--en nist 
make. 

Strucfuruty of fcv.- lings, beliefs, ajid comiitments in the 
arts may be made re 1 want to the ways men ccimunicate with 
each otlw. 

Exercise of freedons through which men speak freely, join 
qraips, explore social alternatives, and yield their assent 
rationally are legitimate. 

To achieve such ends, subjefct-imatter fields are explored as a basis for prac- 
ticing and refining skills of disciplined, practical judgment. (Raup 

et al., 1943). Further, teachers plan and guide activities, including 

class discussions, which stress the clarification of student values in 

light of student understanding of subject matter. The Man^Centered Realm 

addresses itself to the value clarification dimensions of class discussion. 

In practice, value clarification assumes different guises and is 
reflected in different patterns of students' language choices. Students 
react verbally, revealing their value judgments and personal feelings 
relative to a situation. Students examine those understandings and con- 
cepts most vital in their lives and through which they make sense of their 
public and private behavior choices. Students identify or invent personal 
and social policy alternatives and explore the benefits and costs likely 
to be incurred. Students posit an ideal state of affairs or resolve a 
policy conflict by developing a consensual basis for arriving at agreement. 
Hence, value clarification becomes the focus of the Man-Centered Realm and 
is an integral aspect of sij^jject-natter learning. 

Tlye Man-Centered Realm provides a ^or>ceptual focus Which is applied to 
planning, leading, and einalyzinq class discussions designed to help students 
clarify their values. l-Jhen the teacher begins to structure situations and to 
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raise questions desigried to elicit stijdent behaviors in Realm III, he 
is more likely to secure student responses if his questions are based 
on student understandings developed Li Realm I and if he considers the 
Non-Verbal Realm as an aspect of his conceptual nrriel of class discus- 
sion. 

Rsalm IV -- bton-Verbal 

Non-Verbal Realm provides for the collection of data identifying 
periods of silence or confusion which acconpany class discussions. While 
t±ie SSOR is basically a verbal systan, these two diirvensions of non-verbal 
behavior are iirportant categories in the system. 

Silence enables students to organize their thoughts. If the teacher 
makes an instructional move designed to elicit student behaviors in either 
the Subject-Centered or the Man-Centered Realms, the best evidence that he 
wants students to respond and that he places instructional value on his 
questions is his willingneiss to wait while students collect ard frane their 
thoughts for presentation to the group. If the teacher respects the ideas 
and opin.ions of his students, one of the most effective ways of coimunicat- 
ing his respect is to reinain silent after each student finishes speaking 
until he is relatively certain that the student has presented his thoughts 
to his cwn satisfaction. This pause or waiting period is an exanple of 
silence as it is recorded in the SSOR. 

The Non-Verbal Realm also includes a gross form of behavior designated 
as confusion. Instances in which students lai^h, several stidents talk at 
once, the teacher or students talk so quietly tliat they cannot be understood, 
or student dialogue degenerates into a shouting match are all instances of 
confusion. 



;il^^uu>'' Mu'.'^c twrj catcfjories of behaviors — silence and confusion — 
are deliberately Ixjilt into the model, SSOR data may be used to estinate 
t}-\oir f miction in class discussion. Although the Social Science Observation 
I^vord is accurately catalogued as a verbal systen, the Non-Verbal Realm is 
a viable caqxDnent. 

To recapitulate, the SSOR encorpasses four realms. Tliese realms stress 
student understanding of content, teacher-control behaviors, student value 
clarification, and teaclier or student non-verbal behaviors. The preceding 
discussion of the four realms is sumnnarized in Figure 1. The first column 
designates each realm by Roman numeral; the second designates each realm by 



Realm 


Realm 






Number 


Label 


BTployed by 


Major Focus 


I 


Subject centered 


Students only 


Understanding 


II 


Teacher centered 


Teacher or students 


Facilitation 


III 


Man centered 


Students only 


Value clarification 




NOn-Verbal 


Teacher or students 


Inaudible responses 



Figure 1. The four realms of the SSOR. 



its name; the third indicates whether each realm is used by students* teacher, 
or by both the teacher and students; the fourth reviews at least one ma jar 
function for each realm. 



The realms of the SSOR are used interac±ively. The Subject --CenterGd 
Realm establishes, reviews, or diagnoses student understandings and the 
adequacy of their concepts. This understanding becones either the basis 
for or the focus of man-<:entered inquiry • In the latter instance, students 
engaging in value clarification first demonstrate that thev understand the 
subject of inquiry and then engage in value clarification* When a discussion 
proceeds in this manner, the flow is frcm the Subject-<:entered Realm to the 
Man-Centered ReaLii. 

Class discussions may also flow frcm the Man-KZentared Realm to the 
Subject-Centered Realm. If during the course of a value clarification dis- 
cussion students recognize a need for more data, more accurate interpreta- 
tions, or definitions of new words, they may nxjve to the Subject-Centered 
Realm until these needs are fulfilled. Then they may return to the Man- 
Centered Realm* 

The teacher is not limted to observing student moveinent between Realms 
I and III. Preferably, he takes an active part. For exairple, he plans and 
transacts strategies to stimulate students' man-centered statements. He 
elicits preferences, ideals, policies, and feelings* He then uses instances 
of student behaviors evoked in the Man-Centered Realm as the focus of subject- 
centered behavior* He asks students to collect and interpret data according 
to analytical concepts to gain insight into hew they as students value, decide, 
share feelings, and identify and afply ideals, Subject-<:entered learnings so 
derived then became the focus for helping students consider the consequences 
of their valuo-basod behaviors and of inviting students to consider hcM they 
might wish to rrrxlify the maans they use for sharing feelings, making dcxrisions. 



impImK-TiMncj idcs-Us, -inl affirriryj j>irsoral inrl nvxip nroforfnre.q . 

A 'V/nmic intar action Ix-'tACtin these tv.'O reaL-r-s is significant. Siibject- 
centerod sbribenents add Validit::y, --iepth, and canplexity to man-contGjro-'. in- 
quiries. At the same time, man-centej-ed incTuiries become relevant points of 
departure for subject-centered incTuiries. 

Vtays in which Roalins I, II, and III may be \ised systematically ,are pre- 
sented schematically in Figure 2. Arra^ A depicts the flow of stixJent verbal 
K-)ehavior frcn the Sul^ject-Centered to the Man-Centjered Realm v/ithout teacher 
mediation. Arrow D depicts the flew of student vearbal Ir^havior frcm the Man- 
Centered Realm to the Subject-Centered !^lm without teacher irediatic?;. Arrows 
B and C shew the flew from the Subject-Centered Realm to the Man-Centered Realm 
£ind from the Man-Centered Realm tx) the Subject-Centered Realm, respectively, 
with teacher mediation. 
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Student subject- 
centered statements 
expressed during 
class discussion. 



Teacher-centered 
statements expressed 
during class 
discussion. 



Student man-centered 



statements expressed 



durina class 



discussicHi . 



Figure 2. The flow of verbal behavior in the SSOR. 
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Figure 2 stressed the flew of discussion on the basis of the verbal 
realms and ignores the Non-Verbal Realm. Figure 3 incorporates the Non-- 
Verbal Realm and identifies six paths along vrfiich discussion may move 
betv>^n Realms I and III. 



Sub ject 



centered 



Sub ject 



centered 



Sub ject 



centered 
Su bject 



centered 



Sub ject 



centered 



Subject^ 



centered 



4 



Non- 



verbal 
Non-- 



verbal 



Non- 



verbal 



Teacher 



centered 
Iteacher 



centered 

Teacher / Non- 
centered \ verbal 



\ Teacher 



centered 



4 



Non- 



verbal 



Man 

centered 



Man 

centered 



Man 

centered 
Man 



centered 
Man 

centered 
Man 



centered 



Figure 3. The flow of verbal and non-verbal behaviors in the SSOR- 



The four realms of the SSOR enable one to think systematically about 
class discussions* To think vdth precision it is necessary to couple an 
understanding of the realms with a knowledge of the seventeen categories 
embraced by the system as a model for discussion germane both to the develop- 
ment of student understandings and to the clarification of student values. 
These categories are now presented and discussed. 
Categories of the SSOR; A Functional Introduction 

Hie 5?ocial Science Ctoservation Record recognizees sevont^^en categories 
of behavior. Within this descriptive system no category is "good/" no 



- 20 - 



Btsi copx mn^^ 



catixion' i-> "lv*l." Fach cntXKjory niay, according to a teacher's ot-)jectives, 
0| orate fiinctiomlly as <v\ <ir;jxjct of student and tmacher bf}haviors. The 
seveiitcK^n ratoqorios arc sim/eynd rapidly here in order to provide infor- 
nvition relative to their location with the four realms and to stress that 
each rnay function during class discussions. 

The Subject -Centered Realm contains five categories of statesnents 
topical , enpirical , interpretive , defining, and clarifying . These are listed 
and at least one fxonction for each identified in Figure 4. 



CATEGORY OF STATEMENT - 
NUMERICAL DESICmTION 


CATEGORY OF STATEMENT - 
NAME 


CATEGORY CF STATEMENT -• 


1 


Topical 


Mdintaining focus 


2 


Enpirical 


Stating facts 


3 


Interpretive 


Assigning meaning 


4 


Defining 


Avoiding seiiantical 






confusion 


5 


Clarifying 


Elaborating ideas 



Figure 4. The subject-centered categories of the SSOR. 



Coding, using these five categories, is limited to identification of students* 
behaviors. Thus, teachers conceptualize, plan, guide, and analyze discussions 
with precision where the goal of instruction is one of developing student under- 
standing . 

The Teacher-Centered Realm also contains five categories of statenents — 
informing , corrientary , dissonant , interrogative , and confirming . These also are 
listed and at least one function for each identified in Figure 5. 
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CATE3G0RY OF STATO^SEITr - 
NUMERICAL DESIO^TION 


CATEXX)R!ir OF ST?\TEMEM* - 
NAME 


CATEX30RY CF STATEMENT - 
RJNCTION 


6 


Inf inning 


Criticizincr 


7 


Cannentary 


Consolidating and 






structuring 


8 


Dissonant 


Requesting clarifica- 






tion 


9 


Interrogative 


Eliciting responses 


10 


Confirming 


Reinforcertient 



Figure 5. The teacher-centered categories of the SSOR. 

Bo^ii the teacher and students use these five categories of behavior. All 
teacher talk nwst be assigned to one of these five categories. Thus, the 
teacher uses these categories to organi25e, manage, conduct, react, and 
direct class discussion. 

The Man-Centered Realm also contains five categories of behaviors — 
preferential , oonsequential , criterial , iitgaerative , and emotive . One function 
for each of these categories is identified in Figure 6. 



CATEGORY OF STATEMENT - 
NUMERICAL DESIGNATION 


CATEGORY CF SmTEMENT - 
NAME 


CATEGORY CF STATEMENT - 

njicnoN 


11 


Preferential 


Assigning value ratings 


12 


Consequential 


Anticipating effects 


13 


Criterial 


Identifying grounds 


14 


Imperative 


Considering decisions 


15 


Bnotive 


Expressing feelings 



Figure 6. The man-centered categories of the SSOR. 



BEST COPY AVAILABLE 

'ftily .sL.Klonts' lx*Uivior£5 aro ^-^/Vd, i:jc\ U''i<:hors plan value clra"if ication 
it-Mviti^^s .uii fl i '';r*<Kssinns on l*n(» hxisis of thr»'y» catcfjori^s* 

TrT' :K^n-ycrhil RraLm consists of catr^jories — silenco and confus ion. 
Fi'^jijT^^ 7 lists at least one fuiiction for each category. 



CATF)a)RY OF STAn MENl' - 


CATRGORY OF STATET^TT - 


CATEGORY OF STATR^TT - 


NIJME3UCAL DESIGNATION 


riAME 




16 


Silence 


Vfait time 


17 


Confusion 


Adjustment tiir^e 



Figure 7, The non^-verbal categories of ths SSOR. 

The seventeen categories of the SSOR are surmarized according to realm^ 
nunerical designation, categorical Label, and at least one function as shown 
in Figure 8* These seventeen categories enable the teacher to plan and lead 
class discussions designed to eventuate in student understanding, value clari- 
:"itKl^ion, or both with precision and purposefulness. To secure these bene-- 
fits the teacher needs to raster definitions for each of the seventeen cate- 
gories. If there is a fXDSsiblity that the services of a trained analyst will 
be available, the teacher should begin to practice thinking of each category 
not only by its name but also by its na*Ty?rical designation. 
The Seventeen Categories Defined 

Each of the Categories constitutijig the fra^ of the SSOR are defined 
next. The :::rrjor which accorpaiiies the label for each category 
is ^2kc: ncninal nuniber by whiich the category is coded by analysts. 
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REALM 



CATEGORY OF STATEMENT 



FUNCTION 



I. Subject 
cjentered 



1. 


Topical 


Maintaining focus 


*-> 


Empirical 


Stating facts 


3. 


Interpretive 


Assigning meaning 


4. 


Defining 


Avoiding semantical 
confusion 


5. 


Clarifying 


Elaborating ideas 


6. 


Inf inning 


Criticizing 


1. 


Connentary 


Consolidating and 



II, Teacher 
centered 



8 • Dissonant 

9 • In terrogat i ve 
10. Confirming 



structuring 

Requesting clarifica- 
tion 

Fliciting responses 
Reinforcenent 



III. Man- 
centered 



11. 


Preferential 


12. 


Consequential 


13. 


Criterial 


14. 


Imperative 


15. 


Qnotive 



TVssigning value ratings 
Anticipating effects 
Identifying grounds 
Considering decisions 
Expressing feelings 



IV, Non- 
verbal 



16 • Silence 
17 • Confusion 



Wait tijT^ 
Adjustment time 



Figure 8. The seventeen categories of th- SSCJR. The functions as given are meant 
to 1x2 illustrative but not inchisiv'^, (iiourco: 3. l>:jy]o Casteol and 
Robert J. Stahl, c. 1972.) 



-24- 



CatocjKjry 1: Topi cal sta tonents 

Stuciiints express topical statcncnts to identify aixl maintain the focus 
of discussion. Tofiical statai^nts give direction to stident stataiients in 
other categories. The focus of discussion may a theme (fear) , a concept 
(permutations) , an issue (law versus morality) , a problon (ecological im- 
balance) , or a ciuost:ion {Btm can we best explain the Arerican Revolution?) . 
Often the topic of discussion is presented b^/ the teacher as he initiates 
class discussion. When students restate or attoipt to restate the topic of 
study voluntarily or in response to teacher directions or questions, state- 
ments are coded as topical statememts. 
Category 2: Qrpirical statements 

Einpirical statements provide an objective thrust to class discussions. 
When students specify data, numbers, names, and events, statefients are coded 
as «3iipirical statements. When students share kncMledge or what they believe 
to be true, these statements are also coded as empirical staterents. When 
a student reports what he lias read, heard, observed, viewed or r3>-«nt)ered 
as descriptive data, the assumption is that he accepts and expects the group 
to accept Jiis stataiients as factually accurate. If either the teacher or 
students disagree, the statement heretofore purported to be an empirical 
statement bocones an interpretation. If the sti*3ent chooses to repeat the 
iic-a as one he still believes to be accurate, the statement beccnes his in- 
terpretation and is thus coded as an instance of category 3, or an interpre- 
ts tivr- statement, nn^^irical statcTR-^nts occur as sbjdents acquire new know- 
lodf}(^ review kjicuvledae, or seek to pool knc^vledge gemiane to a discussion. 
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Category 3: Interpretive statgnents 

Interpretive statements ocx:ur v^ien students seek to assign meaning to 
data, experiences, and behaviors. When students claim that data or ideas are 
gemane to the topic of discussion, their statements are coded as empirical. 
When students claim that data or ideas are not relevant to the topic of study, 
these are coded as interpretive statenients. When students corpare or differ- 
entiate betv^«sen objects, events, situations, policies, etc., statements are 
coded as interpretive. When students generalize the meaning of more than one 
piece of data (what was read, said, seen, etc.), these are also coded as inter- 
pretive. Students' interpretive statements are frequently prefaced by such 
phrases as "I think that," "In my opinion," "I guess that," and "It might mean." 
Although these are not always valid cues that an interpretive statelet is 
about to be made, in most instances students do proceed to assign meaning. 
Category 4; Defining statements 

Defining statements enable groups engaged in class discussion to develop 
the attributes of concepts logically and to use new words. The use of this 
category tends to provide for semantical clarity and to enable students to 
develop understandings on the basis of analytical concepts. Defining state- 
ments are read from or remanbered frcm an acxreptable source (textbooks, read- 
ing , dictionary) . Defining statements are expressed extensionally through 
listing exanples. Defining statements are expressed operationally in behavior- 
al tems. Defining statements for concepts are expressed in terms of relevant 
attributes. Defining statements may be (but seldom are) expressed as ideal 
types by students. 
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Category S: Clar ifying stuitrncints 

riarifyirKj Kbitcinents aro used when stidcnts oLiboratn on or use other 
verbal maneuvers to ijnprovG tho crnminication of what they have said or are 
about to say. Students clarify by restating rainbling ranarks nore concisely 
("What I'm trying to say is..."); and students clarify by restating ideas in 
more detail. Clarifying state>Tir?nts frequently occur as phrases containirri 
such v^rds as "because/' "personally," "it's liJce this/' "in this situation. 
In effect the student states that he has a "personal" basis but does not 
report, it as his criterion. 
Category 6: Inf inning statements 

Infirming statements are statements rejecting or criticizing stateinents 
made by either the teacher or other students. When an idea is labeled as 
wrong, inaccurate, or needing improvenent to be acceptable, an inf inning 
statement delivers the iressage. Canrents intends, to ridicule a student or 
such reactions as "Shut up," "Calm it down," "You're too noisy/' "You 
aren't followijig directions," and "You've nissai the point" are also ex- 
anples of infirming statements. \<\yere the intent is to identify flaws in 
an othcrv/isG souid idea, infirmnc statements are often preceded by a cory- 
plimentary introduction ("I can see value in your idea,") and then trans- 
lated into infirming stitanents ("hut I believe you've left this inforr^tion 
out."). As the realms and categories of the SSOR are defined, both teachers 
and students make infirming statements. 
Category 7: Ccmcntar y statGnonts 

Cc mentary statements are nade by teachei-s in order to initiate, sur^ 
rarire, or structure. Com&ntar/ stater.o.nts are codGd v;hen the teacher 
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responds to studtint requests for infonmtion, opinions, values or directions. 
If the teacher identifies the focus of discussion, the statements are coded 
as "camientary." If the teacher provides a definition or describes a crite- 
rion for purposes of helpiivg students to interpret the maanijyg of data or to 
make a decision, his statements as he presents the definition or criterion 
are ccm«ntary statements. All instances of narrative, teacher talk not 
clear instances of infirming, dissonant, or confirming statements are ccm- 
mentary statements. Rhetorical teacher questions are also coded as ccm^tary 
statements. Although students use this category to review directions, this is 
almost exclusively a teacher category when the teacher leads a class discussion. 
Category 8; Dissonant statements 

Dissonant statements have three inportant purposes: to express a need for 
clarificetion, to inform members of the groi?> that one is intellectually con- 
fused, or to point out that a participant (or participants) is making state- 
ments which are inconsistent with one another. Typically, teachers expletives 
C^^iat?", "Huh?", "Say that again!") fall into this category. SUdents typ- 
ically use this category by erploying short statements suc}i as "Is this what 
you want me to do?" or more likely "I don't understand." As the realms and 
categories of the SSOR are defined, both teachers and studfjnts use dissonant 
statar^ents . 

Category 9: Interrogative statements 

Teachers use interrogative statements any time they raise a question. 
Teachers may use interrogative statements to elicit any of the ten categories 
of statements reserved exclusively for sturlent verbal behavior in the Subject- 
Centered or the Man-CenteretJ Realms. If each of these sturl'-nt categories is 
thought of as a move, t' teacher may us<? interrogative st/ii.ernents to ini.tiate 
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ton stirlont v>rhil nxjvos. As tJv> milms r^ntl catry^ories of the SSOR arc 
dofinocl, lx)t-in r:M.rionts arvl bo^ichors nvike intorroaativf? statcmRnts. 
Catojory 1 0: Conf inning statements 

The tencher or students use confirming statanents to reinforce the 
behavior of the teacher and of students. I^cliers use confirming statanents 
in expressinc] acceptance of a student's idea or l^ehavior; in acknowledging 
agrcoment with tl"»e ideas of students; and in encouraging students to continue 
a line of thought or valuation using such expressions as "I see," "Great," 
"Keep going," "Don't stop new," and sometiiiies "Wbw." Students use similar 
expressions to confirm one another, to confirm the teacter's statements, ard 
(unless the teacher is careful) to confirm their questions and encourage tl-^e 
teacher to ansv>er his cwn questions, the questions interded for students . As 
the realms and categories of the SSOR are defined, either the teacher or stu- 
dents may use confirming statements. 
Category 11: Preferential statements 

Students use preferential statements to assign value ratings to ideas, 
policies, situations and other objects of valuation. Preferential statements 
frequently occur as students judge objects of valuatiwi using such words as 
"good," "bad," "best," "wrst." Students also use preferential statements to 
convey their likes and dislikes. Preferential statements occur when students 
selcjct the preferable option fron a limited number of alternatives or rank 
order objects of valuation frcm the most to the least preferable. Prefer- 
ential statements also occur as students classify objects of valuation, group- 
ing those they consider most preferable, least preferable, or both. 
Category 12: Consequential s tatements 

Students use consequential statements to express v^iat they perceive to 
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h? kncwn or anticipated effects. When students list the effects of a 
situation (poverty) , they use consequential statements. When students 
list the benefits and costs of a public policy (open housing) , they use 
consequential statanents. When students identify the results likely to 
e\'Gntuate fran their personal feelings or preferences, they express con- 
sequential stater^ts. When students list the results likely to occur if 
a given interpretation is accepted, they use consequential statanents. 
Student expressions designed to identify the effects, results, benefits, 
or costs of an idea, a condition, a decision, or a feeling are all coded 
as consequential statements. 
Category 13: Criterial statements 

Students use criterial statements to identify the grounds or norms 
implicit in, or deliberately being used to guide, tl^ir thinking, their val- 
uing, or their actions. Criterial statements also serve as frames of ref- 
erence, enabling students to state preferences, determine consequences, or 
decide between policy alternatives. Criterial statements may be conditional, 
in wliich case phrases such as the following are incorporated: "If this is 
true—/" "When one is faced with this type of situation—/" "Let's say one 
wants to do this—," "ajppose you felt m this way—," and "Imagine you were 
in his place — - " Each phrase sets a condition for what has been or what is 
abcxit to be said. Criterial statements my be nomBtive: "All men are equal, 
"To use authority is had; to be permissive good," and "7U.1 human life is valu- 
able . " 

Category 14: Inperative statements 

I rfx?rative statements focus on decision making and decision reporting. 
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St.uionts ufy^ ijnfx^rat ivc ::ta^*imf?rits to identify altoiTiative policios which 
nii^ht used to chanqe a situation; to statp v/hat they belie^/e o^jaht to be 
.ti}™ ought not tn bo true, thus ^I'^scribirvj ideal corriitionsr and to iden- 
tify actions which should be t aken or shcxild not he taken. Further, v;hen 
students as individuals or as members of a group formulate arci r^X)rt actions 
they intend to take, they use inperative stateTients. 
C ategory 15: Elriotive statements 

Emotive statCTHnts function to express strcaig perscHial feelings. When 
students report how they felt, hew tJiey currently feel, or how they would 
feel tcvard an idea, a situation, a policy, or a consequence, they use emotive 
staten^ts. Einotive statements are ooncemed witli the feelings of sta- 
dents or with physical sensations students experience when these are expressed 
in a manner which denotes a sense of feeling, smell, or taste* 
Category 16: Silence 

Silence is used when the stxxients or the teacher wait for or take time 
to fornnulate a verbal or non-verbal response to a question or idea. When 
students are corpating an answsr to a problem in mathenatics or studying some 
picture projected on a screen, a brief period of silence may be expected. 
Silence also denotes the beginnina and ending of coding in the SSOR. 
Category 17: Confusion 

This category is used to record /^xhal and non--verbal noise \^ch accom- 
panies, interferes with, disrupt'i, or makes ijnpossible discussion. Confusion 
is also used to record student or teacher verbal statements stated so softly 
that the coder (and by inference members of the group) cannot deterrine v;hat 
is being said. 
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Ohe seventeen categories of the SSOR enable the teacher to plan 
and lead discussions with categorical specif icxty. The teacher plans 
subject-centered leamiiig a::tivities using categories 1 through 5 to 
develop student understanding. The teacher uses categories 6 through 10 
to help plan his instructional behavior as teacher. The teacher plans 
man-<:entered learning activities using categories 11 through 15 to 
stimulate student value clarification. These seventeen categories ard 
a short definition for each category are reviewed in Figure 9. 
Suninary 

The Social Science Observation Record contains four realms and 
seventeen categories. The four realms are Subject Centered, Teacher Centered, 
Man Centered, and Non-Verbal. Realm I stresses student understanding and 
includes five categories of students statements: topical, empirical, 
interpretive, defining and clarifying. Realm II stresses teacher 
transactional behaviors and includes five categories which both the 
teacher and students erploy: inf inning, caimentary, dissonant, interrogative, 
and confirming. Realm III stresses student value clarification and embraces 
five affective categories of student statements: preferential, consequential, 
criterial, inoperative, and emotive. Realm IV comprises two non-verbal 
categories: silence and confusion. The classrocm teafccher who understands 
the SSOR may use his knowledge of these four realms and seventeen categories 
to plan and lead class discussicMis systematically. For these purposes, he does 
not require the assistance of a trained analyst. Before ho can use the 
services of a trained anadyst, when such is available, needs to understand 
hcM data are oollected and organized for feedback and ait? lysis. This information 
is discussed in Cha^pter III. 
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Chapter III 
THE SSOR AS AN OBSERW^TICN INSTRUMENT 

An Introduction 

The Social Science Ctoservation Record provides classroom teachers 
and instructional theorists with a model of classroom discussion. Because 
the Social Science Ctoservation Record can also be enployed as a systonatic 
observation systen, trained coders can collect data enabling teachers and 
theorists to analyze class discussions as they occur and thus to compare 
what happens in practice with what was or might have been originally antici- 
pated. Prior discussions of the Social Science Observation Fjecord have 
stressed that classrocm teachers need not have the services of a trained 
coder to think about and sl-..'-^e ideas about class discussions in terns of the 
Social Science Observation Record. This chapter details how a reliable coder 
and trained ctoserver collects, organizes, and interprets data which can be 
used by classrocm teachers. 

\\(hen the reader has conprehend.ed this chapter he should be able (if 

provided with data by a trained coder) to organize and interpret data using 

the SSOR as liis frame of reference. Given these skills and a knowledge of 

his objectives the teacher can proceed to analyze \^t occurred, and, should 

he desire, he can plan strategies for modifying his behaviors, the behaviors 

of his students, or both. To achieve the greatest benefit fron this chapter 

the reader is advised to follw three disciplines: 

. . . .Think about the categories by nimerical designation rather than by 
label. This is necessary because data are collectod and manipulated 
using numbers as referents for the seventeen categories of the SSOR. 

. . . .Master each section of this chapter as it appears before proceeding 
to tl-<e next section. The sections are cumulative anrl as the reader 
moves from section to section a knowledge of previous sections of 
th*D presentation is presijiied. 
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...study carefully the figures as these are referred to in the text 
of the presentation. These figures stress tools and concepts 
necessary for the organization and interpretation of SSOR data. 

If these three disciplines are follcwsd, the reader should acquire under- 
standings and skills by which he can organize, interpret, arri analyze SSOR 
data. 

Collection of SSOR Data 

A coder trained to use the SSOR records what occurs during a class 
discussion on a three-second-interval basis. He assigns tte appropriate 
number which designates the category of behavior he "hears" occurring during 
each interval. He can be pictured as mechanically listening to a discussion 
in segments of tliree -seconds duration and encoding each segment. He codes 
the events in each interval, assigning to it a number representing one of 
the seventeen categories he lias trained himself to recognize. Because he 
records on paper as he mentally codes, what occurs can be retrieved, organ- 
ized and interpreted. Because he records what he hears every tliree seconds, 
an adequate sanple of data concerning teacher and stvdent behaviors is 
collected for the reconstruction and ancdysis of class discussion. 

For each minute that an analyst codes behavior he records at least 20 
times. At the end of five minutes he has recorded at least 100 times, at ths 
end of ten minutes 200 times. If he "hears" two different behaviors occurring 
within tlie same three second interval, he codes both in the order in which he 
hears them. This is done to preserve as ccnplete a record as possible of what 
is occurring. A trained coder codes about 20 times for each minute of 
observation, auring periods of rapid interchange among students and the teacher 
he will code more frequently. 



How a trainod cxder collects data ard tJie way in v^ich discussions 
may be reconstructed using }us data con be clarified by reconstructing the 
data presented in Figure 10. As the analyst begins to observe, code, and 
record the discussion, he records a 16, the designation for silence, indicat- 
ing that he did not, as an analyst, hear vrtiat occurred earlier in the dis- 
cussion. As he listens to the class discussion, he codes teacher or student 
behaviors for each three-second interval. In the example the teacher begins 
ty structuring a question using camnentxiry ard interrogative statanents 
{categories 7 and 9). Students respond to the teacher's question by express- 
ing aipirical statenents (category 2) . The teacher resporxls by using a 
second interrogative statement (category 9) which results in a shift in 
student behavior to the expression of interpretive statements (category 3) . 
In response to and following the two instances of interpretive statements, a 
student conveys his feelings through an emotive statement (category 15) . 
When the teacher (or a student) reacts with a question (category 9) , a student 
expresses a preference (category 11) wfiich leads to sane confusion, perhaps 
laughter or hostility (category 17) . The teacher reinforces the preferential 
statement using a confirming statement (category 10) . This leads students 
to express a criterial statement (category 13) and a consequential statcanent 
(category 12) . When the discussion is concluded or tlie coder decides to 
terminate his coding (in effect, to stop "hearing") , he indicates this con- 
ventionally ty codixvg silence (category 16) . 

Ten minutes of coded data are presented in Figures 11 and 12. The data 
in Figure 11 were collected during a social studies discussion conducted 
in an in-service workshop in St. Paul, Minnosc^ta. The dat^ in Figure 12 
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Cateqory 




coded by 

trained 

coder 


Explanation of events occurring in the class 
discussion durina each three seoorri interval 


16 


By con'' mt ion, interaction analysis data are 
initiated by coriing silence. 


7 


The teacher enploys a ccmnentary statement 
to initiate the discussion. 


7 


The teacher begins to structure a question 
to \vhich he wants students to respond. 


7 


The teacher continues to structure the con- 
text or his question. 


7 


The teacher finishes structuring the context 
within which he wishes students to respond. 




The teacher uses a question intended to 
elicit student statenients. 


2 


A student expresses an enpirical statenent. 




Ttie same student or a second student expresses 
what he believes to be a factual statesiient. 




The teacher asks a second question. 




A student expresses an interpretive statement. 


3 


The same student or a second student expresses 
an interpretive statement. 




A student conveys personal feelings in the form 
of an emotive statanent. 


q 


Ttie teacher {or a student) asks a question. 


11 


A student expresses a value rating in the form 
of a preferential statement. 


17 


A period of noise recorded as confusion occurs. 


10 


Ihe teacher encourages tne stident to continue 
by confirming prior behavior. 


13 


A student states the basis for his reasoning by 
expressing a criterial staterrent. 


12 

• ■ • 


The same student or another student anticipates 
an effect using a consequential statement. 

The discussion continues. 


16 


By convention, coders irriicate the end of a 
discussion or terminate their collection of 
data by using the nuirber that designates 
silence. 
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Figure 10. The reconstruction of SSORdata. 
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SSOR DATA COLLECTION FORII 
(Cjsteel and Stahl) 
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Figure 11. SSOR data for a mathematics teacher. 
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SSOR DATA COLLECTION FORI! 
(Cttteel and Stahl) 
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Figure 12: SSOR data for a social studies teacher, 
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were collected during a discussion in a irathematics classroom at Howard 
Bishop Middle School, Gainesville, Florida. Examination of the data reveals 
that the social studies teacher elicited a large number of nan-centered 
student behaviors (categories 11 through 15) occurring in conjunction with 
definitions and interpretations (categories 4 and 3 respectively) . An 
analysis of the data for the mathe ratios teacher differs in that a greater 
number of student subject -<:entered behaviors (categories 1 through 5) were 
observed with special emphasis on enpirical data (category 2) . The classroom 
teacher can look at such data-collection sheets and determine: (1) if the 
coded behaviors are the behaviors he expected, (2) if the behaviors were the 
results of his own behaviors, and (3) if so, to what degree he affected the 
beliaviors. 

If interest is limited to a general picture of what occurred, the data 
sheet alone is useful. If one instead wishes to analyze a class discussion, 
the data sheet is not sufficient* For purposes of analysis, the data must be 
transformed into sane kind of interpretive display. This transfoniation is 
accomplished by transferring raw data into a matrix. This transformation 
is initiated by pairing. 
Pairing and Tallying Data 

When SSOR data are collected, any category as coded may be followed 
by any of the categories in the system. For example, an enpirical statanent, 
category 2, may be followed by category 1, or 2, or 3, or 4, or 5, or 6, or 
7, or 8, or 9, or 10, or 11, or 12, or 13, or 14, or 15, or 16, or 17. An 
interrogative statonent, category 9, may be follovs^ by category 1, or 2, 
or 3, or 4, or 5, or 6, or 7, or 8, or 9, or 10, or 11, or 12, or 13, or 14, 
or 15, or 16, or 17, This possibility exists for all seventeen categories. 
Because each of the categories may be followed by itself or any other 
category, 289 sequences of categories are possible. When the seventeen 
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catecjories of the SSOR are used to construct a watrix of ordered paixs, 
the 289 sequenced pairs (17 X 17 = 289) are referred to as "cells of 
inquiry" (see Figure 13) . SSOR data as collected (see Figures 11 and 
12) are conc/erted to this matrix for interpretation and analysis. 

The first task in converting data to the matrix is called "pairing." 
Data representing forty-five seconds contain fifteen pairs (the 45 seconds 
observed divided by the 3-second interval for coding equals 15 pairs) . 
Data for forty-five seconds are paired here. 



Second pair 
Fourth pair 



16 

r 7 

^ 7 
, 7 
^ 7 

, 9 
^ 3 

r 3 

^15 

r 9 
^11 

,10 

^10 

16 



First pair 
Hiird pair 
Fifth pair 



Fifteenth pair 



The first pair is the 16-7 pair; the second is the 7-7 pair. The second 
number in the 16-7 pair becones the first 7 in the 7-7 pair. The fifth pair 
is a 7-2 pair arx3 the sixtli pair is a 2-2 pair. Except for the number with 
which coding begins and the number with which coding ends, each number used 
to record data is part of two pairs. This procedure is follcwed until all 
data collected have been tabulated into pairs and transfered into the matrix. 
Pairing "stores" the interaction between categories of the SSOR an3 serves 
as a basis for tallying data and entering it into the SSOR matrix. 
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SOCIAL SCIENCE OBSERVATION RECORD (SSOR) MATRIX 



.). Doyle Casteel and Robert J, Stahl (c. 1973) 
College of Education, University of Florida 
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Figure 13: Tht- 289 cells of the SSOR, 
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Data are first tallied into the SSOR scattojr diagram (Figure 14). After 
data have been collected and paired, each pair can be assigned to one of the 
289 cells of the SSOR matrix. For the forty-five seoonis paired above, i±B 
first pair is 16-7 and belongs in the 16-7 cell. To determine where to place 
a tally to convert this pair into the SSOR matrix; read down the left-hand side 
of the scatter diagram to the number 16; this locates the first number in the 
16-7 pair. Next read left to right and locate column 7; this locates the 
second number in the pair. Where the tw nuTibers intersect the 16-7 pair is 
tallied. This intersection of categories 16 and 7 is designated by the letter 
"a" in Figure 14. When referring to matrix data, this is read as category 16 
followed by category 7. The second, third, and fourth pairs are 7-7 pairs. 
To tally these pairs read down the left of the scatter diagram to category 
7 and then left to right to column 7. Where the two 7's intersect is the 
appropriate cell in which to tally the three 7-7 pairs. In Figure 14, this 
cell is designated by the letter "d." The fifth pair is a 7-2 pair. To tally 
read down the left of the scatter diagram to the number 7 and then to the right 
to column 2. In Figure 14, this cell is designated by the letter "c." This 
procedure is continued until all data are paired and tallied in the scatter 
diagram. The number of tallies for each cell are then counted and the total 
transferred to the equivalent cell in the SSOR matrix (see Figure 15) . 

As pairing was iniUally discussed, an observer codes an event and records 
a numerical designation for the behavior which occurred. The subsequent behav- 
ior coded can designate any category in the SSOR incluJing itself. Frequently 
the same behavior will last for an extended period of time. In the SSOR systan, 
the seventeen intersections or cells in the matrix which record and descrite 
these extended behaviors are called "extended state cells" (see Figure 16) . 
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SSOR SCATTER DIAGRAM 
J. Doyle Casteel and Robert J. Stahl (c, 1972) 
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Figure U: SSOR scatter diagram with cell* for three paire designated by the Icctcrs 
a, b, and c.. 
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SOCIAL SCIENCK ObSERVATlON RKCORD (SSOR) MATRIX 

Code 

I. Doyle CaaLeeJ and Robt-rt J. Stahl (c, 1973) 
Colh'ge of Kducation, University of Florida 
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Figure 15: Data transferred into the SSOR ratrix. 
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SOCIAI. SCIENCE OBSLRVATION RECORD (SSOR) MATRIX 



J. Doyle Casteel and Robert J. Stahl (c. 1973) 
College of Education, University of Florida 
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Figure 16: The seventeen extended state cells 
of the SSOR matrix 
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For instance, a topical statanent (category 1) followed by another tnrjioil 
jjtatfTV'nt (catecjory 1) yields a 1-1 pair, a category 2 followed by a socorvl 
catajory 2 yields a 2-2 pair, and so forth to the 17-17 pair. This pairing 
sequence holds true for all seventeen categories ard forms the seventeen 
"extended state cells" in the SSOR matrix. Extended state cells record those 
I^irs of data where the first number and the last number of the pairs are 

the same (1-1, 2-2, 17-17) . ihese pairs or cells indicate that the 

particular behavior observed lasted an "exterded" or six -second period of 
tiine and was recorded as suoh. 

One of the major purposes for transferring the raw data into a matrix is 
to enhance the descriptive and analytical potential of the vSSOR matrix. In 
addition to setting up the data for simple tabulation of frequencies and per- 
centages for each category and realm, the matrix system allows for an examina- 
tion of the sequence of behaviors within the total interaction. 

The matrix format generates data which would not be available using fre- 
cjuency counts alone. Because data are organized into a matrix and because of 
the characteristics of the SSOR system, the resulting matrix data can be inter- 
preted in a number of ways. Some of these are described briefly below. 

(a) Total Data Count . Assuming the trained coder codes and records 
approximately every three seconds ard every time there is a 
c}iange in category, there are twenty codings per minute, ^tore 
frequent codings than this indicate a series of rapid behavior 
changes froti one category to another. 



(b) Total Number of Cells Used . With 289 cells existing within the SSOR 
matrrx, the use of a number of cells indicates that a variety of 
verbal patterns occurred. When a variety of different cells are 
used, the frequency of use for each cell is often limited. An in- 
crease in the total number of cells used may suggest a flexible 
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teacher, a randan discussion, or a discussion in which a variety 
of different verbal behaviors occurred. The authors have not, as 
yet, explored these three or other possibilities for interpreting 
data in reference to total cell count. 

(c) Extended State Cells . The SSOR matrix not only indicates which of 
the seventeen extended state cells were codexl, but reports the 
frequency totals and percentages of these behaviors as well. 

(d) Category Usage . While seventeen categories exist in the system, 
rarely are all seventeen observed during a class discussion. The 
matrix identifies not only those categories which are used; it also 
indicates those not used. Both ways of analyzing data provide 
valuable insights as to what occurred. Category data are also pro- 
vided in terms of the frequency of occurrence for each category as 
well as in terms of the percentage for each category of behavior 
observed. 

(e) Realm Usage . The four realms of the SSOR are identified and separated 
in the imtrix by heavy lines malcing the examination of realm data more 
convenient. Ihe data in Realms I, II and III are sub-divided into 
five parts (categories) each while the fourth realm has two sub-divi- 
sions (categories) . Realm data allow for interpretation as to vrtiether 
student or teacher verbal behavior predcminated, and as to v^ther stu- 
dent behavior stressed understanding, value clarification, or both. 

(f ) Sutinatrices . The 289 cells in the SSOR matrix lend themselves to 
logical groupings or ccmbinations of cells called subnatrices . Each 
of the twelve suhnatrices has unique attributes. An understanding 

of each in terms of the entire matrix adds still another interpretive 
dimension. 

These aspects of the SSOR matrix ray be used to analyze SSOR data. Shculd one 
want to analyze and interpret collected SSOR data in order to describe classroon 
discussion behavior he will need to understand the kind of data provided by the 
matrix. 

An explanation of a sample SSOR matrix may serve to enhance the reader's 
oiderstanding of how the data in matrix form can be interpreted. Figure 17 
contains data for approximateiy fifteen minutes of discussion collected under 
micro-teaching conditions. A pre-service social studies teacher was told to 
lead a discussion on the ijiportance of sexual equality. Her students were five 
seventh graders sttidying world geography. The teacher was fulfilling the intem- 
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Total Count 301^ Cells Reached (289)__;03___Cate8orles Used (17) 16 

Extended State Cells (17) 8 

Figure 17: Fifteen minutes of SSOR data for a social studies teacher. 
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ship assigrment necessary for certification. The data in Figure 17 are 
interpreted below. 

In the example, there were 301 recordings of which 119 ware student 
verbal behaviors in either the Subject-Centered or the Man-Centered Realms; 
173 were teacher-centered behaviors. Thirty-nine percent of the behavior 
coded was student verbal behavior in Realms I and III of the SSOR (27% + 
12% respectively) . Consequently, tJiis discussion is called a directed 
discussion. Had student verbal behavior been one percent more, the discus- 
sion would have been a guided discussion. 

The teacher helped her students to identify and pool enpirical data 
(category 2) , to interpret the meaning of the data (category 3) , and to 
clarify and elaborate on their ideas and opinions (category 5) , She prob- 
ably cculd have helped them spend more time in defining (category 4) the 
term sexual inequality. Her students did not emit any instances of topical 
statements (category 1)/ thus denoting that at no time during the discussion 
did they themselves identify the focus of their discussion. 

The teacher helped students to clarify their values with regard to 
sexual inequality. While students used all five of the categories in the 
Man-Centered Realm, they tended to enr^^hasize criterial statements (category 
13) and inperative statanents (category 14) . students stated the basis for 
their reasoning and identified alternative policies more often than they stated 
their preferences and feelings. 

The teacher erployed and made regular use of three categories of state- 
ments in the Teacher-Centered Itealm. Her behavior suggests that she frequently 
needed to provide directions, give new information, consolidate past events, arri 
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sot the stage for her questions. All th^. above-mentioned teacher behaviors 
oro codec! as category 7. She frexguently nsked questions (category 9) (seme 
which book longer than three seconds— cell 9-9) aiid indicated her acceptance 
of student behaviors (category 10) . The behaviors recorded in Realms I and 
III strongly suggest that her behaviors in Realm II were facilitative. The 
teacher relied heavily on cormentary and interrogative statements to guide 
the discussion. Both criticism (category 6) anS reinforconent (category 10) 
were used, but neither appears to have been orployed excessively. 

In the Non-verbal Realm, silence (category 16) was seldon recorded. 
VJhen silence did occur it did not last more than three seconds, leaving the 
16-16 cell aipty. In no instance did student verbal behavior in either the 
Subject-Centered or Man-Centered Realms follow silence. Of the three occur- 
rences coded, the teacher each time initiated the verbal behaviors with which 
silence was broken. 

Of the 289 cells in the matrix, 103 cells (36%) were reached. This 
indicates that the teacher and her students used a nupj^er of language patterns, 
incorporating sixteen of the seventeen categories during the discussion. 

In terms of looking at specific cells or verbal patterns, the 13-14 pair 
occurred five times while the 14-13 pair only occurred on:;e. While the teacher 
reacted consistently to student imperative statements, she did not respond to 
student criterial statements. The 5-2 cell count indicates that five tines 
during the discussion students sought to clarify previous statanents by refer- 
ring to empiric data to assist them. The one tally in the 11-11 cell airi the 
absence of tallies in the 15-15 cell indicate that stixlents did not objectify 
their preferences and feelings for any extended period of tiire. 
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The teacher reinforced student behaviors in both the Subject-Centered 
Realm (the 2-10 and 3-10 cells) and in the Man-Centered ReaLii (the 11-10 
and 14-10 cells) . It may be inferred that the teacher wanted stidents to 
e>cpress themselves in both the Subject-Centered ard Man-Centered Realms. 

The teacher used ccnnentary statements (category 7) to structure her 
questions (category 9). Evidence supporting this statenent is found in the 
7-9 cell. Eleven different times she used conmentary statements to set up 
her questions. I^ss than half of her questions, however, were longer than 
three secorids in length and tended to be followed by stcK3ent subject-centered 
behaviors. The teacher seldon answered her own questions (the 9-7 cell) . 

If the teacher's goal was to lead a directed discussion in which students 
developed understanding and clarified their values with regard to sexual in- 
oqualiiy, the data in the mtrix suggest that she was sixx;essful. If the 
teaclier wished to lead a guided discussion, she might have imt her goal had 
sl-h? resjXDnded less frequerjtly to student interpretive, preferential, ard im- 
perative statements and waited for students to determine ways of expressing 
and elaborating their ideas and values, or had she not respoi-ded to her own 
questions. Of these tw it wuld appear tliat sh2 may liavo wanted to increasu- 
use of silence inasmuch as she already used the 9-16 cell but apparently did 
not wait long enough for students to speak after brief periods of silence. 

The SSOR mtrix is usually interpreted in the light of known teacher ob- 
jectives. The foregoing discussion does demonstrate lx)W a teacher can dis- 
cover intuitive purposes guiding his beliaviors by cbtaining ssOR data, tallying 
his data in a scatter diagram, building a matrix, ard proceeding to interpret 
his behavior. Whether he carries out these tasks by hijnsolf or the.se are done 
tay a trained observer, he possesses a mirror by which he can -"jroan himself 
as a discussion loader. 



Su>jTBtricos of ti to f^sOR Matrix 

If tho rl.iRsroan teacher or obser/er v/nnts to increase his powers of 
analysis arvl i ntorf^retation further, ho needs to uivlerstancl rlifferent sec- 
tions of the SSOR matrix called suhnatrices . Suhnatrices are small groups 
of related cells which identify special kinds of interrelations useful for 
matrix analysis. 

The SSOR matrix contains twelve logical suhfTBtrices . These are desig- 
nated by capital letters from Submatrix A through Subrratrix L. Ilie location 
of these twexve subinatrices within the SSOR matrix are shown in Figure 18 . 

Subnatrix A . This subnatrix contains twenty-five cells or verbal patterns 
of student subject-centered statements that occur when a discussion ra.ains in 
the Subject-Centered Realm for more than one three-second interval. The use of 
these cells indicates that students are interacting with one another, and as the 
use of this subnatrix increases, discussions terd to be either guided discussions 
or open discussions. Extensive use of this subnatrix ard of a niarher of subject- 
centered cells suggests that students can operate irdependently in the Subject- 
Centexed Realm. For the teacher whose objectives include stident understanding, 
Submcitrix A constitutes a major focus for planning, guiding, and eventually ana- 
lyzing his class discussions. 

Subnatrix B. This subnatrix provides twentv-five cells for describing how 
the teacher reacts to student si'bject-cente.red behavior. If one wants to know 
what subject-<:entered behaviors v^xe inf inned or confirmed, he f irris the necessary 
data in Subnatrix B, To determine what categories of student subject-centered 
behaviors led the teacher to make cormentarv statenents or to use interrogative 
statements, one examines Subnatrix R. vtjen teacher-centered behaviors are 
heavily concentrated in Subnatrix P,the following inferences can be drawn: the 
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Figure 18: The 12 submatrices within the SSOR matrix. 
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discussion tf>nds to be a marginally direct or lecture discussion in which 
students are reviewing or drilling? the teacher is not structuring a context 
for his questions and is probably asking low level knowledge questions; and 
the teacher is asking a nunber of questions followed by short subject-centered 
student statenients during each ndnute of discussion. 

gutnatrix C . This sutmatrix contains twenty-five cells for recording 
student man-centered statements which follow but are contiguous with subject- 
centered statements. Extensive use of this sufcinatrix indicates that students 
know how to move from the Subject-Centered to the Man-Centered Realm ani per- 
ceive that such behaviors are a legitimate aspect of inquiry which occur in 
conjunction with the developnent of cognitive understanding. If a teacher 
encounters students who perceive value clarification as inappropriate class- 
roon behavior or if he is atteinpting to increase his students' abilities and 
willingness to affirm and share values, incxenients in this sutmatrix would sug- 
gest progress tcward these goals. 

Suljnatrix D . This sufcinatrix contains twenty-five cells for recording 
student subject-centered statements to teacher-centered behaviors. How stuients 
respond to criticians, to reinforcement, to comients, to requests for clarifi- 
cation, and to questions by expressing themselves in subject-centered categories 
can be detected by analyzing this sufcmatrix. If the majority of student subject- 
centered behavior collects in this suhmatrix, the discussion is probably a 
marginally direct or lecture-demonstration discussion. If student behaviors 
cluster here and teacher verbal behaviors cure clustered in Submatrix B, one 
infers that students are reciting or reviewing, or that the teacher is raising 
lower level cognitive questions, and that student responses are congruent with 
the questions posed by the teacher. One could speculate with some reasonableness 
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that students are engaging in designating and verbalizing without due 
regcird for whether or not they understand what they are saying. 

Subrutrix E . This subinatrix contains twenty-five cells or verbal 
patterns for recording teacher-centered statements following othsr teacher- 
centered statements. All teacher-centered statements lasting at least six 
seconds in duration are recorded in this sufcmatrix. If the teacher crit- 
icizes student verbal behaviors and proceeds to follcw his criticism with 
other kinds of statements, the teacher's statements, with the exception of 
his first statement, will be recorded in Sutmatrix E. The teacher wanting 
to examine the manner in vMch he structures his questions would expect to 
investigate his use of the 1-1 , 7-9 cells. Suhnatrix E provides the teacher 
with data as to the kinds of verbal behaviors he engages in during the class 
discussion. It provides inforrtBtion relative to the kinds of statements 
that he uses to guide and manage the class discussion as well as data about 
the frequency of these stabt-'nents . Students can also use teacher-centered 
categories. Since students' use of the teacher-centered categories tends to 
be quite minimal, student use of these categories is seldom reflected in 
Sutaratrix E. 

Sutmatrix F . This submatrix contains twenty-five cells recording how 
students react to teacher-centered behaviors when they respond with man- 
centered statements. Vlhen the teacher deliberately uses his influence to 
elicit man-centered behaviors, this is indicated by codings in Subnatrix F. 
Student man-centered statanents which coincidentally follow; teacher talk are 
also recorded here. If the only man-centered statements coded are located in 
Submatrix F, the data may be interpret«3 to mean that students did not express 



or attcrrpt to clarify their values excerpt at the direct request of the 
teacher, and these statements were extranely brief. If Subtatri^ F is 
used about as often as Sutmatrix H, it suggests that the teacher quickly 
responds to student man-centered behavior. If Siteatrix F data are aocon- 
panied b^' data in Subnatrix I, this is interpreted as indicating that the 
teacher used his influence to elicit man-oentered statements and tliat stu- 
dents ccxTtinued to engage in value clarification behaviors as a result of 
the teacher's influence. 

Sutniatrix G . Suhmatrix G contains twenty-five cells for recording data 
vghen students voluntarily move fron the Man-Centered to the Subject-Centered 
Realm. This can be interpreted in different ways. If Sutmatrix G is used 
almost as often as Suhinatrices C and F and if Sutmatrix I contains little or 
no data, students are probably responding briefly to teacher requests for value 
clarification statements and returning ininediately to the Subject-Centered Realm. 
If SubTGtrix G is used in conjunction with Sutmatrix I, students are probably 
returning to the Subject-Centered Realm to collect, share, and interpret more 
data; to clarify their man-centered staterients; to define a traiblesone concept; 
or to reestablish the focus of discussion. The same data may indicate that 
students are analyzing hew they engaged in value clarification. 

Sutmatrix H . Sutmatrix H contains twsnty-five cells of verbal patterns 
describing hew the teacher responds to student behaviors in the Man-Centered 
Realm. If this sutmatrix is used in conjunction with Sufcnatrix F and if little 
use is made of Sutmatrix I, the data are interpreted as meaning that tte teacher, 
who wants to secure value clarification statements fron his students, is reacting 
too quickly to student responses in ths Man-Centered Realm. 



Sufcmatrix I. Like Sutnatrices A and E, Sutmatrix I data indicate in~ 
depth realm usage. Whan man-centered student statements tend to gather in 
Sutmatrix I, this suggests that students are alleged to express their values, 
their ideals, their grounds, and their feelings for long periods of time 
without teacher intervention. Behaviors in Sufcmatrix I are interpreted as 
meaning that value clarification of a prolonged nature is occurring. For 
the teacher whose objectives include value clarification, Sufcmatrix I beccmes 
a major focus for the analysis of class discussions he plans for and teaches 
toward. 

Sutamatrix J . This sufcmatrix contains thirty cells, VJhen silence or 
confusion follow subject-centered, teacher-centered, or man-centered state- 
ments, these behaviors appear in Sutmatrix J. Sutmatrix J is further divided 
into three five-celled segments. The first segment of J (J^^) describes the 
silence occurring after student behavior in the Subjec±-Centered Realm. The 
second segment (J2) records silence following teacher-centered behaviors. 
The third segment of J (J^) records the silence following student man-centered 
behaviors. If segment 2 is used but segments 1 and 3 are not, the data suggest 
that the teacher believes his questions and ideas are worth consideration but 
those expressed by his students are not of equal value. This description of 
Sutratrix J places deliberate stress on the silence or "wait time" component 
of segments 1, 2, and 3 of the sufcmatrix. 

Sufcnatrix K . Sufcmatrix K also contains thirty cells. This sufcmatrix 
records what student or teacher behaviors follow silence and confusion. It, 
too, is sub-divided into three five-celled segments. The first segment (K^^) 
indicates v^t, if any, student subject-centered statements follow silence. 
The second segment (K^) is used if silence is follcwof! by teacher-centered 
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behavior. The third sogrrKjnt (K^) is used if silence is follcjwed by 
student man-centercx3 statements. The three segments of Sufcmatrix K were 
aeliberately stressed hare to alert the reader to the inifxirtance of who 
(teacher or student) "breaks" the waitinq period. 

Sutaniatrix L . This sutmatrix contains only four cells indicating the 
int€jractional possibilities of silence and confusion. Silence can be inter- 
preted as either an indication that students are fonnulating ideas or that 
they do not know how to respond to the situation. If silence translates to 
confusion, whether this be descriptive noise or a student speaking so quietly 
he cannot be understood, the latter interpretation can be justified. Periods 
of confusion can be nonral manents of excitement or adjustment or they can 
indicate that the teacher needs to step in and restructure the discussion. 
If cxDnfusion translates to silence, the first interpretation can be argued; 
if confusion remains stable, the second interpretation beccmes more probable. 
Tliis sutmatrix is important if one wishes to study exterded periods of 
"wait time" (Rowe, 1973) . 

Knowledge of the twelve sutmatrices increases the ability of the teacher 

t. ) plan, w'^ch, and analyze class discussions. An idea of the data generated 

b^' the LSOR matrix may be grasped by studying the matrix sLunnary sheet in 

FiguT'-' 19. The teacher can cast objectives, monitor class discussions, and 

analyze data using different diirtensions of tJie SSOR. 

Summar\' 
A- 

This chapter has presented information essential for the collection, 
organization, and interpretation of SSOR data. Data are collected on a three-- 
second- interval basis and may be used to reconstruct class discussions. 
Once data have Loen collected, categories used contiguously are arranged in 
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ordered pairs and tallied in a scatter diagram. After the data have been 
tallied, the cxxmt for each cell of the 17 x 17 scatter diagram is entered 
into the equivalent cell of the SSOR matrix. When data have been transferred 
to the SSOR matrix, category totads and percentages, realm totals and per- 
centages, extended state cell usage and percentages, and cell totals are 
cai^:uted. If the teacher's objectives are available, data may be used 
to examine the degree to which his objectives are met, (See Figure 20) . 
If the teacher's objectives are not available, his intent and purposes 
may often be determined by studying the available data. 



SSOR DATA 
DESCmBING THE 

CLASSROOM 
INTERACriCN 



TEACHER'S 
PLANNED OBJECTIVE 
FOR THE CLASS 



Figure 20: Hie relationship between SSOR data and teacher planning objectives. 

One question Which may be on the mind of the classroon teacher is: 
"Can knowledge of the SSOR help me to shape my behavior in directions I 
want to go?" Chapter IV will discuss pilot studies relevant to this question 
conducted by the authors using a sixteen-category earlier version of the 
SSCR systan. 
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QiAPTCR IV 
REPORT ON PILOT OTJDIRS USING THE SSOR 

An Introduction 

In previous diapters, the Social Science Observation Record has been 
presented as a theoretical construct. Hew the SSOR is used as a model of 
class discussion for purposes of helping students engage in indicative 
(subject-centered) and value clarification (man-centered) inquiries has 
been explained. How the SSOR as a category observation system is used to 
collect, organize, and interpret data has been described. In this chapter, 
data fran pilot studies are reported. 

The studies reported here focus on four questions: 

1) Observation instmnents have been used by student-teaching super- 
visors to help student teachers modify their instructional behaviors 
(i^don and Hough, 1967; Bondi, 1968, etc.) . Can the SSOR be used 
to secure changes in the behavior of interns? 

2) Observation instruments have been used to collect data with regard 
to what does not occur in the classroon during student-teacher 
interactions (Flanders, 1970; Ober et al, 1971) . Can the SSOR be 
used to analyze the non-occurrence of expected events during inter- 
actions between students and teachers? 

3) Interval observation systems are inclusive in that a limited nuiit)er 
of categories are used as if these were the only diinensions of behav- 
ior WDrth observing (Medley and Mitzel, 1963) . If the opinions of 
instructors of social studies methods courses are accepted 

as a criterion, do the categories of the SSOR capture data with re- 
gard to significant classroom events? 

4) Interval observation systems have been used to collect descriptive 
data and provide feedback to teachers concerning their instructional 
behavior. Ttiis feedback has enabled teachers to teach subsequent 
lessons in which their intents as teachers (goals) and their behaviors 
as teachers (performance) are more congruent (Flanders, 1970; Rosen- 
shine and Furst, 1973) . Can teachers use SSOR feedback to align vthat 
does occur during teaching with vshat they expect to occur (plans)? 

Tentative answers to these questions are to be provirled in subsequent sections 
of this chapter. 
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Ntxl i l'_^'irKj Ins tructional Behavio r 

Tho shaping potential of tlie SSOR was initially explored during the 
wintor viucirtor of 1972. The SSOR was used as a feedback device to modify 
Llie Ixiliavior of interns in directions desired by the researchers. This 
ntuJy was conducted: 

detorminc if each of the sixteen categories of the SSOR identified 
at this tiine were categories used by teachers in social inquiry dis- 
cussions. 

To increase the total number of categories used by each teacher par- 
ticipating in tlie study. 

increase the total number of extended state cells used by each 
teaclier participating in the study. 

To increase tlie numix^r of cells of the SSOR nvitrLx used by each teacher 
{)tii-ticipatin<j in tlic study. 

dctonnine how many of the 256 cells contained in the SSOR nutrix 
could \x} obtained in practice. 

To secure ti\c opinions of participating teachers as to the practical 
classroan effectiveness of feedback based on the SSOR. 

Siv suijjecLs i^articipated in the study. All participants were under- 
graduate students at the University of Florida and planned to bocane social 
stuiios teaclx}rs. All were engaged in student teaching in the same junior- 
senior high lichool (gi-ades 7-12) at the time of the study. All had studied a 
wil.ic clarification liandbook called "Verbal Strategies of Valuing" (Casteel, 
JO(.B), in [irt'fxiration for tlie study. All participants ware assur^xJ tliat tJvir 
(xTfominco daring the study would not in any way detract fran tlieir grades. 

Participants v^r^re instructed to identify five students fraii one of their 
cLissos with wiiom they felt secui'e and wlio \^3^uld be willing to participate in 
uvi )-^>vni I I'i micro-teaching sessions. Particii^ants were encouraged to prepare 
(for each nucro- teaching session) a separate value sheet congruent with liDuis 
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Raths's concept of the value clarification process (Raths et al, 1966). 
They vjore infonnEd that each value sheet should be one that students had 
not seen prior to each micro-- teaching session. Fach value sheet was to be 
one related to the content being studied in the class tliey v^re currently 
teaching. Particii>ants \vere also asked not to discuss the SSOR or their 
feedback sessions with others until tlie study had been concluded* To 
protect the anonymity of each participant, student teachers were assigned 
letter clesiquiitions and are referr€3d to as subject A throuqh F, 

The six subjects taught two micron-lessons one v^eek apart. Tv^ sub- 
jects tauqht a session for three consecutive nights. Subjects A, E, and F 
selected senior high school students. Subjects B, C, and D selected junior 
hiah school students. 

All micro -lessons v^re taught in the evening at the P. K. Yonqe Lab- 
oratory School. The rocxn, roan arrangement, and observers were the same for 
all session.^. Except for the first micro-lessons of subjects A and B, video 
tape replay was provided for each participant and her students. 

Each student teacher tauqht for approximately ten mijnutes. As 6vach 
taicher tauqht, an obse-r\^er coded wmt was occurring durinq each three -second 
interval according to the categories of the SSOR. Between -observer reliabilitv'^ 
for the caiers was computed according to Scott's formula (Scott, 1955); the 
coefficient: of inter-ob5>erver agreerrent was ccarputed at 0.86. 

While each teacher watched the video tape replay of the lesson udth 
students, SSOH ^Ut^i wcire oraanized into a matrix for interpretation. After 
video tape x-oplay, each subject di.smissed his students and returned for a dis- 
cussion of SSOR data. Durinq this conferojice each subject was lielpod to iden- 
tify two or throo cateqorios which had not been used or had been \ised sparingly 
durinT the first lesson. Each subject was then encouraoed to use ncM cMteqorios 
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and to increase the frequency with wtiich other categories were used during 
his second lesson. Each subject was helped to identify extended state cells 
not used durinq the first lesson and ajsked to use these cells during his 
second lesson. Each subject was also assisted in an analysis of Sufcimtrices 
A and I of the SSOR mtrix. SSOR feedback procedures, used follainnq rhe first 
micro- teaciiL-i!-, sossion, vrere repeated for the second session. 

Sixteen of the sixteen categories in the SSOR system at the tim^ of the 
study were coded as having occurred during the tv^slve lessons. This suggested 
that the categories included in the system do identify and describe classrocm 
behavior used by teachers in social inquiry discussions. 

Five of six subjects increased the total nuirber of categories they used 
fron the first to the second micro-teaching session (Figure 21) . The sixth used 
fifteen categories in his first effort and used one less during his second session. 



16 




A B C D E F 

Subjects 



I I First session score Second session score 



Figure 21. The nurnber of categories used by the interns. 



Tha average nunixsr of categories cxxted for the first lesson \^ 12.3 

categories; for the second lesson tiie nean was 13.5 categories, "Utere 

was an average gain of 1,2 categories (9.7%) for all subjects. 

nie results of this study suggest -^lat categories of the SSOR can be 

used to describe instructional behaviors occurring during classrocn 

interaction. 

Five of six subjects increased the total number of extended state 
cells coded from the first to the second lesson (Figure 22) . 




A B C D E F 



First session soore Secxjnd session sccfire 

Figure 22. The number of extended state cells used by the interns. 

Sixteen extended state cells existed in the SSCJR systen at the time of 
this study. For tlie first te<TCher the mean miriber of extended state 
cells used was 8.17. For tlie second, the mean number of extended state 
cells used was 10.0. Itiis is a mean increase of 1.83 for extended 
state cells (22,4%). An increase in extended state cells may 
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lio nssot^ivitccl witJi use of rnoro cateqories for i^istaincH^ periods of time. 

All six siibjcvts mcrt^ased the total nunvVir of cells used fran the 
first to the second session (Figure 23) . The average nunibeir of cells 
coded for the first lesson was 56.8 colls whdle tJie second session 
rcxirordod aii average of 68. B cells per subject. This represents a nx^an 




I'i^mro 21. Tho r.Biib^r of total ceilr^ used by the interns. 



.fi-c^v'Mi of i.\0 c'^li.s (21. V) -per .sub'uxM- for tho s^x::onci .se.«;sion. 
"tii?; qrowtlT I'w/ rolnfed to an incroaso in viy? nunibGr of catnoories 
;nihio-t- aftanf)tfxl to use. It suqgrsts that the.so catrxjories foila^«d 
othor (-at-o<!orios in a nuinh>o;- of rjiff.irejnt wav'r; rather th^n the ron- 
tiniial use of the sa:x; coi'hlnation of catoqor ^ fr\^i . 
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ot the 256 total cells in the 16 X 16 matrix, 171 cells v^re used by 
the six interns (see Figure 24) . This represents 66,8 percent of the total 
number of cells* All 256 cells or verbal patterns do exist and can be used 
durinq classroom discussion. The data indicate that within the time limits 
provided during the study many of these cells v^ere reached. Results of tliis 
study warranted the tentative conclusion that the SSOR can be used to help 
teachers chai^^e the number, kinds, and length of verbal patterns of behavior 
<xx:urring during class discussions; further, this change may occur in direc- 
tions desired by teachers as well as by researchers. 

Each subject was asked to write a reaction paper carmenting on his ex- 
perience with micro- teaching and SSOR feedback. All subjects submitted a 
brief appraisal. Two reported that the experience had been of no value and 
suggested ti^t the time between the twD teaching sessions was too short. Four 
reix)rtod that they had modified class discussion behaviors as a result of 
participation in the study. They claimed they felt more secure in their role 
as te^icher and attributed their increased confidence to feedback provided in 
tonus of the SSOR. 

The results of this stody are to be interpreted cautiously. Since no 
oontrol group was used, the changes found between the first and second teaching 
sessions could have been the result of seme factor other than the feedback 
procedures described. Nevertheless, some conclusions are drawn with oonfi-- 
dence. Student cat€}gories of the SSOR do occur during class discussions. 
Interns werr .ibie to secure changes in their discussion behavior. A majority 
of thf^ interns {Jarticipatirig in the study believed that SSOR feedback helped 
thcjn to chincjo their behaviors in directions they valued. 
Analyzinc^ Non- occuring Extents 

Observation instruments sensitize observers to expected events which 
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oiUK^r do not oc\'ur or occur loss frequently than anticipated. I'Xita 
i'oU«x'ti\l in t-Jv pilot study roportocl above wc to analyzed in this fashion. 
Mho aailysin diat ioUa-/s illustrates how a toachor nviy uso tiit^ SS(X^ in order 
j(. U-.>M!u> -txT^' !AiMisitivv> Lo sruiont Ix^ha vicars >iuring class disc"a:;s io!\. 

"■inl-' v>no instance of topical statcnonts (catotory 1) ms cod^xi fc^r 
twolvv' tiMchiiKi sossi«^ns. The six suljjocts failod to elicit statt-!i:v^rn::; 
rrxiaiviii^l [W^ ux-us of instruction frcni their studcints. Instead, each 
t(Mo!',..'r tonuxi t.o reviov,' an.i present the focus of instruction for his 
ntudonts, ■M-nnq th(^ ini{)lications of this teachimi behavior one fii-^is: 
(1) tho toachors were willinq to rink the assunption that students undci*- 
st.xxi aivi ofxild use tne focus of instruction to guide tlieir Ixihavior? 
(.0 tiii» .io :rcx- to v;hich students in fact used the focus of instruction 
as a ir.-uik-' of refexenco within which to slwe relevant information, 
a:?:'.i.!r'. ruMp.inq, .inLl rrvike value jufiqejiients is problematic ; (3) and the 
failure to ^^lioit overt stataiients as to the focus of instruction nioans 
tJ-uu Uio torn*' of discussion was not used to analyze relationshi[is aiix^iM 
th.' i.ii.i n^jYn-Led, tiie cn^injons expressed, and values affimied by stu- 
'i MU;:;, tL^niini t/) restrict s+udent inc(uiries during micro -1 essons to 
loivvu hA'. ds of Uiinkino and valuing. Teachers involved in this stidy 
ran n<^etil(\'^:s risk wlion they chose not to elicit topical statenients to 
rwiintain {uurioso fulness, .and left unoj-ienod this doorway to cognitive and 
afhx-tive inalysis of relationships. 

Viv,^ cf t)ie sLx toachoi-s mule no effort to elicit from studt:^ts the 
Ui'us for th(^ ideas tJiey expressed, tlie values they affirrnod, or tJio 
ixihlic tx>1irn.\s they suggested (category 13, criterial staterncnt) . Pm^n.i 
th(^ ini-l io.;l ions of t_his data, one finfls: (1) since students did not 
e.';ta»>iisl-< anl niate grnum.h^ of ^■J^c^^inq, thijiking, and valuing, Uiov couM 
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not orKjano in nile-qovornGd rational Jxihaviors; (2) since students did 
not aailv-^o tho tosis for their ideas and values, they could not objecti- 
fy the ideals ard standartls wiuch quided their verbal bohivior; an^l (3) 
stuients limited th<.inselves to the persuasive tool of explainino or re~ 
phi-asinvi rJieir previous staterv-^j\ts (cateqor^' 5) and identiiyinu j-ossiiue 
.uid proJvihie results (cattviory 12). What was lost was the identification 
of the .Troiir».is or txisis for the decisions made so that the consequences 
•ml lolicies could more apf^ropriately judqeri as good or bad. 

Tlic taichers elicited few defininq statements from students. Vhere 
suidents were asked to define tenns, teachers accepted casual definitions. 
N<i sul:>joct sounht to help students build a definition in the form of a 
numjx^r of concrete examples, a rajor approach used by historians. No 
subiect o|-)to:l to help students develop .in nnerational definition, a coiFion 
af)f}rcvK:h valued by social scientists. No subject attej^iptec^ to help stu- 
dents list .-ritorial attributes for lanciuage terms to which they referred. 
•■VionM t.ho i-^n cations of hw v^rrls cir^l concepts wore defined, one finds: 
H) thi^ micro-lessons as taunht were inconsistent with procedvires fourrl 
rn histon/ and the social sciences, fields presuired to provide social 
stuiies teachers with proceduiMi rulos tJiey are expected to use and teach 
stuionts to use durinq «xxrial inquiry; (2) tJie ndcro- lessons as tauqht 
w>r<^ tnc'onfustent witl\ consensus-s(v»kinq pnicoduros in that seirantic con- 
fusiori Wis riskeri; and Ci) the tevichers, all teachinq social studies, 
ikrv 'nntrattvl no overt: concern to help studenfs develop or clarify social 
Sf-ienco concepts, alUio^nh conceptual Instruction is considered to b^ one 
of tho -ajor chairacteristics of the "n(v" srvjial studios. In diis resixx:t, 
t:v> uvnlvf micro- lessons tauqht were more .-il:in to rap sessions tJ-uan to 
'liscipl inai Lncjiiiri<\s. 
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The preceding analysis illustrates hew the SSQR is used to inter- 
pret expected events which either do not occur or occur less frequently 
than expected during class discussion. Teachers can use such data as 
the basis for rethinking how they plan and teach. 
A Survey of Social Educators 

Results from a survey of selected instructors of social studies 
methods courses are reported in this section. Ihe purpose of the survey 
was to determine if the sixteen categories of the Social Science Observa- 
tion Record as they then existed were categories which woiiLd be perceived 
as being significant by those surveyed. 

In the spring of 1972, thirty-two questionnaires were miled to a 
selected sanple of social studies educators. The first page contained 
category labels for sixteen categories cind asked that the respofxient 
assign a value rating to each category, A second page provided the re- 
spondent with a short definition for each of the sixteen categories. A 
copy of the definitions used by respondents is shown in Figure 25. 
Eighteen respondents returned questionnaire- as requested. 

Instructions as to hew the questionnaire was to be answered were 
brief: 

Belcw you will find sixteen categories of verbal statements that can be 
einitted or elic:ited during oral social inquiry. Rate the relevance 
of each category for social inquiry according to the following code: 



Since the intent of the survey was to assess the opinion of social studies 
educators, t)ie plirase "oral social inquiry" was deliberately left urdpfij»d. 
Ihe assumption was that each respondent would rat^ each category in terms 



1. 
2. 
3. 
4. 

5. 
6. 
7. 



Very insignificant 
Insignificant 
ScneiNhat insignificant 
No qpinion 

Sanesr^t significant 

Significant 

Very significant 
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of his own particular frame of reference • 

The vsord "significant" was selected as the basis for a continuumf 
according to which categories were to be ranked. The intent was to choose 
a valuo--free wrd, the rationale being that the identification of negative 
or dysfunctional behavior has value as well as does the identification of 
jx\siLivo and functional l:)ehavior* In some instances this result was not 
realized, particularly with regard to categories 7 (cxDnvergence) , and 8 
(confusion) . The coiments of some respondents indicated that they used a oon- 
tinuum moving fron\ very bad to very good . Data for these three categories 
and Realm II are highly suspect • 

Data on t^kow categories were rated are presented in Figure 26 • The 
total score (T) was detennined by multiplying the frequency of a rating by 
the assigned value rating. For exanple, the soore for category 1 wsks coax- 
piled in tins nvannor: (3 X 1) + (5 X 10) + (6 X 5) -f (7 X 2) = 97 . 
In the Subject-Centered Realm, the interpretive (3) and clarifying (5) 
categories were rated as thie most significant (mean scores 6.50 and 5.67 
resjjectively) ; opinions as to the significance of enpirical behaviors were 
most varied as suggested by a standard deviation score of 1.200. In the 
Teacher-Centered ReialrTv divergent influence (category 9) was rated as most 
sigrvificant (a mean scoro of 6.33). Confusion (8) was rated as the least 
shinif Lc.int cut.cK^ory (a mean score of 4.17) in the realm (and in the 
system) • Opinions as to the significance of the category of confusion 
were also more varied than were those for any other category in the systesm. 
In th.^ Man-Centered Realm, criterial (13) and policy (14) statannejats were 
ranked most highly (a iman of 6.62 and 6.56 respectively); hcMever , 
preferential (11) and consequential (12) statements were also ranked as 
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i'lijUTfc 26. 'iYio sixteen SSOP. categories as ratec^ by tlie social 
€2ducator.s surveyed. 
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significant. Affective stateittents (15) received the lowest ranking [5.11 
mean score) • Opinions as to the iirportance of policy statenients varied 
nxDst as the 1.149 standard deviation indicates • Opinions as to the sig- 
nificance of silence (16) v^e highly varied with seven respondents re- 
porting that they held no opinion as to the significance of silence or 
that they did not perceive silence as being a significant aspect of class 
discussion. 

Data for Realins I, 11^ and III are reported in Figure 27. Realins I 
and III were rated as significant (maan scores of 6.00 and 6,26 respectively) . 
Reabr Tl was rated as son^vhat significant (a mean of 5.38) . However^ 
lxK:ausG the labels chosen for these categories resulted in the tendency 
by the raters to use a good--J:)ad continuum for rating categories 6, 

7, jjvi 3, Si"0}:)ticism concGxnixig the data is warranted. 

This survey suggests that the ten student categories (categories 
1 though 5 and 11 through 15) were perceived as categorizing significant 
ev^ents, who^t- cxrcuirenco or non-occurrence during class discussions is 
important. This survey led to major chariges in Realm II and to the 
nxxiification of sane student category' labels in Realms I and III. 
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An Fbqx:trimGntal Stuciy 

The ixirposc of tliis study was to determine if using tlie SSOR as a fe«i- 
back systeni v^uld load to modification of teacher and subsequent student ver- 
bcil bt^Knviors in directions ttiat pre-sorvice teachers believed desirable. 
Four arovTis of the SSOR which cou'd be used to indicate chanqes in c3assrocri 
vorhal Ixihavior were identified and used for casting hypotheses for tosting. 
It was ^x^stulatetl tliat pro-teachers who received SSOR feedback fcetwecn their 
first ard second micro- teaching sessions would show increases in four areas. 
In brief, this study was conducted to determine if: 

a) those receiving SSOR feedback wuld increase the number of cells 
they used; 

b) those receiving SSOR feedback would increase the nuiTt)er of 
categories they used; 

c) those receiving SSOR feedi:ack would increase their Realm III 
totals; an:l 

d) those receiving SSOR feedback would irjcrease their Sufcnatrix I 
totals. 

These four areas vere selected as foci for the st'xly for several reasons 
Explanation for the choices follows. 

The use of cells in an interaction analysis matrix has been associated 
with teacher flexibility (Baidi, 1968) . This variable was cjonsidered as a 
'teacher flcxibilif/ factor" by the authors at the tine of the stiriy. An 
iry-rrease in tJie total number of cells used would irean that a teacher was 
iKKxming more "flexible" in guiding the classrocri discussion than one who 
remained constant or showed a decrease in cell use. To detemine if SSOR 
fcodixick increcises a teacher's ability to be flexible in the classrxxm, an 
increase in total cells used was selected as the appropriate variable in this 
stixly. 

An increase in the total number of the sixteen categories in tJie 5".SOR 
used vrould indicate that statements performing a greater nuirtxir of furctioi:; 
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haci rx.viirral. An incmise in the tot^-U nimibc^r of catcxjorios would suc^c}er,t 
thkit tlio toachor able to elicit a cxreatcr variety of student Ixihaviors 
as thoy wrro func^tional cxnci relevant to elass discau'^se. An incr<\ise in the 
niinilx^r of cattxiories ojiif^loyod was sol(x_"toil as a varial^lo for anuilysis }x?causo 
it \vns thou<]ht that JWR feedl^ick would alert teachers to more varied kinds 
of KJtwiors tJvit thiy could elicit from stixlents diirinq class discussions. 

I^vilni ITl of the SSOR yields a frec^cncy count of value clarification 
statoj^ients cx-^currin(| durinq class discussion. A qrowth in Rouilin ITT \x^- 
fuiviors was exptvted Doca;*se of the stress placed on "affec:tive" and ^'values" 
t-xiucat ic^n by saual stiKlies nelrhals instructors at the University of F-'lorida 
arxl Ix^Muse o\ tlie strf^n-: "'himmistic" nri(»ntation of the CoIIocto of Mucation 
at t]\c Univorsity of Florida, lhat fxirticifnnts in the stixly desire^i to IcsiCx 
"huiumist ic" iliscussions was later confimrKl in conversation witJi the stu- 
dejnts wiio tnrt ici{-xittxi in the study. An increase in thf^ frequency of R^xiln 
iri Ix^haviors \^^uld irxlicate that hiqh schcx)! stixlents fud increased tlieir 
tisc> of luin-t^Mitc-rocl statejTTuits as classified by tlie SSOK catfxiaries. TV^alpi 
rn totals w('ro also selected as a varKil)lo for analysis Ixxrause it containtxl 
cat.t\iorii\s representative of tiie kintls of statements omfihasiT'/xl b\ contem- 
lxn*aiA' ^^(x-i.jl stiKiies rxlucators as desirable kinds of staterx^nts foi* teachers 

el i.'ii fnin thnir stixlents (Oliver aixl Shiver, 1066; Ncvvmm an:! (Oliver, 
1^7..\- Mi^t.vili, 1071; J'unt iriLl Mx^trnlf, ]'K>H) . 

'Hir ii:>( of Siiixivit r Lx I yicdiis frixiur.^nry crnint of valU'* oKit if i..Mt u'^n 
h^ji.ivi<^rs l.irt iiiM nK^n^ tJii <\-' c( uuu \^ut ive ser^onds. /\n iixT(MS(^ in ^'u}^- 

luUrix I t('tal:: v^r^Mld irxiicMtr^ that .-^tucic^nts not only incnMsrx] tl^t ■ f t\> nierx^v 
of thoir valuc^ c lar i f i(M t i on Ix^hivior:^ hut also .lui :-;(^ i r >t 'j-.torKlo; o^ r c>! 
finx^, A t-en(-h(M' e>:[xx'tinq t.o lead a vihie cLn'i: icat ioii inv^juiiy vv^v.;]j. o/rrxx^t 
to liivo I ] injc> niE.'Jx^r of Lillios in Uur. sul^iivitrix . An Imc^pms^^ •'n S-iU"ii^.ra\ 



I totals was selected as a variable because this would be a wore discriminating 
indicator of student changes in nan-centered behavior than would be frequency 
counts of Realm III behaviors. 

There were ten pre~service teachers in each of the experimental and con- 
trol groups. Each group was assigned in accordance with a Pre-test/Post-test 
cxperiinental design (Canpbell and Stanley, 1963) : 



This design has no control for external validity; hcMever, it does control for 
all sources of internal validity. Standard t-score values and an analysis of 
covariance were used to determine the degree of differesnce betwaen the ts/fo 
groups. Hypotheses were cast in terms of attaining a .95 level of signifi- 
cance in the difference between the two groups. In the analysis of the data, 
differences in group mean scores as well as t values and F ratios are reported. 

To secure subjects for this study, volunteers were sought from an under- 
graduate social studies methods course. The students in the methods class 
yffere shown one video tape of a snail group discussion led by an intern ard 
one showing five high school students responding freely and openly to the 
question "What makes a good teacher?" They were asked to observe the teacher's 
behavior to ietenrune if she displayed behaviors they themselves wDuld like 
to possess. A question and anrswer period, focusing on describing the be- 
haviors and the methods students identified as being associated with "good" 
and effective teaching, followed the first tape. Htc discussion following 
the second tape enrphasized the discrepancies between the behaviors identified 
lyy the metiiods students as "good" teaching in the first tape and those behav- 
iors seen as Ix^ing '"goad" by high school students in tlie seccnd. 

The methods students were then informed that the intern leadinc the dis^ 
cussion in the first fc!:pe had learned a systeanatic way of plannir.g and 
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Uiidinq discussions that they themselves could learn. They wei.e told that 
tlk're was evidence to support the claim that their participation in the study 
MDuld help them to behave in ways they wanted to behave in as classroom 
teachers. 

TwiTity students volunteered. They were randomly assi'jnod to experimental 
uuxi control <iroups of ten students each. All subjects wore told that their 
txirtici|>ation in this study would have no effect on their grade in the oourse. 
All were assigned a time and place for the specific activities in which thoy 
were expected to participate. These activities were: (1) a familiarization 
session with video tape equipnent and the nucro- teaching lab at the P. K. 
Yonqe liOboratory School; {2} a first and oocorid teaching session two weeks 
a'^art durii-ig which they would lead a discussion with four to six high school 
students usintj the same discussion topic for both microti i^achiTKi sossions; and 
(i) a feedback session lasting approximately two hours. All students v^ro 
randomly assigned alphabetical code. At no time? during the study vv^ere 
students told that tliere were exijerimcntal and control groups. 

Each student was randomly assigned to two half-hDur blocks of time exactly 
tvvo weeks apart. (One of the researchers handled the micro- teaching lab and 
oc^uipment during the study.) As each methods student caire trj the mirro- 
tfachinq lab, he or she was introduced to from four to six nigh school stixlents 
w'no aid been randomly selected frcm tlie Study of Man D^^artment classes of the 
scrcol. After a br.^f introduction, the video tape unit was turned on. The 
r'Toarcher then left the room to prevent his presence frcm influencing either 
th<' m^^Uiods student or the high school students. After twelve minutes, tlie re- 
soarcher returned and turned off the video tape recorder. The t.a?x^ wns imTxsdi- 
atc.'iy rt^vjDund, and i^ich irtethods sti^dent watched a vidro tape n:^[jlay of his les- 
son. Once again the r-jsearcher left the nxxn to avoid makinq ccinnentT. on .sug- 
gestions which might contaminate the study. Any "Hawthorne effcjt:' due u> vidtx-) 



r.qx' nv^^y ^^^^^ ^-^^'^ nucro^toadurxj ex}K^riencc must be consider^jd to Iavc opcirattxi 
Gcjually on both groups of participants ♦ 

'Vhe tapes were observod and coded during the afternoons and e/enings. In 
order to insure that differences in the data v^ld not be the result of differ- 
ences between coders ^ one researcher coded all twenty subjects for both thc^ 
first .ml second sessions. UsincT Scott's method for conputing bet\Nieen-obsoxver 
relial^ility, the coder consistently obtained reliability coefficients for intern- 
coder anci intracodei- aggreement between .73 and .79 for SSCSR categories. T^^iis 
coder Wus not told the names or alphabetical code of students in the control 
or exi>-^rinfiental groups. He identified each data-collection sheet by the topic 
discussed as he coded each lesson. When students attended the feedback ses- 
sions, their data sheets were identified only in terms of the topic they had 
chosoj^. to discuss. TVfter all second session tapes had been coded, topics wetre 
matchai to alphabetical codes and naiiies. 

Fooriback was provided to niOT}:»ers of the experiinental ^^roup in a group 
session. Members of the e^qDerimental group came to the Mead Library 0,1 the 
P. K. Ynncje Laboratory School canpus on the evening designated for their group. 
Stucients were told that the i^tiforrrvation they wore going to receive in reference 
tjo their Hi icrc>-t caching session was to be presented in the form of SSOR data. 
Studenis vA^re also told that after they received the data, only guestions 
relatcxl to the SSOR would be answered. The researchers then presented an 
overvic?w of tlie S53C)R. Students received Iwidouts on each elanent in the sys- 
tem as a copy was projected via a transparency on the overhead and discussed* 
At no t was a "good" matxix or a "had" matrix described or suggested. 
TY\ichinc| stra tellies were not discussed. After this presentation of the sys- 
tira, the SSOR nvntxix for each subject was distJ::^i^>ut-yi . Siil^jects were told 
th:it Uiey were not to discuss their data, the SSCM or any isfxx^t nf the feed- 
back session with anyone. 'Hie rese^irchers resrviined availa>)ltj to provide 
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additional explanation of tiic SSOR; however thoy mde it clear that thoy wuld 
nviko no efforts to ovaluatG tho students' matrices. At tlii.s point students 
wcro told they could leave at any tiirrc. Sane left inniodiately while others 
stayod for as long as two hours. (At tho end of the study, maitars ot th- 
control grout') jxirticipatcd in a similar fecxiback session.) 

A SLXte<^n-catapry earlier version of the Social Scicaice Observation 
Hv>cord was u.-xd in tJiis study (see Figure 28) . Besides different iia-tv-s 





CAIBSORY OF STATE^IFNT 


I. .Subject Centered 


1 • IVDpica] 

2 . Errpir ica 1 

3 . Interpretive 

4 . Referential 
5 • E^qplonatory 


TI. Teacher Centered 


6 . Discouraqonent 

7 . Convergence 
B. Confusion 

9 . Divergence 
1 0 . Encouragement 


III. Man Centered 


11, Value Statements 

12 . Consequential 
n Critjerial 

14. Policy rnakinq ! 

15 . Personals-Affective 


IV. Silence 


16. Silence 



Figure 28. The spring, 1972, version of thf» S?OR. 
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tc^r sovorai at tht* cat'-xjorios, this version ot the vSSOR (iiffors fmm the pros-- 
i-ru .Mt«^)ory systoni in tvso respects. First, twD catogoriGS which emphasizcKi 
t.Moht.T-contt.Ttxi converqoJit and divergent behaviors (categories 7 and 9 re- 
sfHH-t ivi»ly) \viVQ since been changed to the present oonmentary and intcirrogvitivr^ ^ 
»'aux5'>ru\s (7 and ) restxTCtively) • Second, the fomer category 8, iabelcxi 

!;vasi'>n, was split into two categories (confusion and dissonant statements) 
;:i tiu' I'fost^it .systau. 

Tin* results of this study stated in the fonn of null hypotheses are 
au;^\;;:>\! alonq with relevant data pertaining to the differeiicc betVi^n the 
;rM;: r^-in'c^, the t valuer aid an F ratio for an analysis of covariance, 

tS-(^ Fi.^un'S 29 anJ 30-) 
yii:\{ Null !lV]x)^heSlS 

iiii^ro w)uld \je no difference in the i.ncrease in the total number of cells 
iS'^i i)v x.h)sc wno rf^oivod the SSQR feedback between the first and second 
ruc! o-t,*Mchin<^ sessions and thoso who did not receive feedback at thi^ tiine. 
hi (»>:,i:ninirvj t\x' difference in th? n^ns between the twD groups, the experi-- 

.iit il *J!oup uicreascd its use of cells by 10,6 cells (21,1% increase) while 
r'.nM ;1 ;roup silowed an increase of only 2.1 cells (3.6% increase). The 
i:v;r t was supfx'irtai by j» t value of 1.5442 obtained for the difference 

iP 'w^^^u th«^ two qroups. A t value of 1.73 was required for significance at 
t;?^ hvi 1 of comidonce for 19 degrees of freedan. (The t vaJuo of 1.5442 
.v<!.> ^ >ur'i] V. si'^nificant at ths .10 level of confidence.) The hypothesis 
v.'a:: il:, . ij.jx^rtod b/ an F ratio of 9.759 obtained for group means difference. 
A:, i' i..' lo -y: 4.45 was rLquured for significance at the .05 level of confidc^c 

! 1 uvi 17 dfyjroor; of freedom. No statistically significant differc^rice at 

livol usuv-j tlic t value and F ratio in terms of an increase m thf"^ uso 
'•'•il;; wfj.s toand between the two groups. The null hypothesis was not ro KXTtcti* 
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f - ' 

Area in v^iich hypothesis v-zas testcad 


t (1/19)^ 


r (1/17)^ 


Iiicrease in coll usage 


1.5442 


0.759 


increase in catxjgories ustri 


1,5132 


1.966 


Increase in Hoaim III totals 


2.0527*^ 




Increase in SiJbmatrijK I t-c>;..". s 


2.1166^ 


5.133^ 



a. MMVP €malysj.s ol varxancc. 

bv Student t test. 

c. Significant at th.e .05 level. 



Figure 29. Student t scores and F ratios for the experiniental 
and control group difference. 

Second Null Hypothesis 

There wculd be no dif ference in the increase in categories used by those 
who received the SSOR feedback between the first and second micro-teaching session 
arxi those who did not receive feedback at t his time. An examination of the 
difference in the means betwean the two groups reveals that the experimental graap 
increased its use of categories by 1.6 categories (15,1% increase) while the 
control group showed a decrease of. 2 categories (1.7% decrease^. The hypothesis 
was supported by a t value of 1.4132 obtained for the difference between the 
two grcd^s. A t value of 1.73 was required for significance at the ,05 level of 
confidence for 19 degrees of freedon. (Tlie t value of 1.4132 was fcund to be 
significant at the .10 level or confidence.) I^e hypothesis was also supported 
by an F ratio of 1.966 cbtairjed for group means difference, to F ratio of 4.45 
was required for significance at thie .05 level of jn^idence for 1 and 17 degrees of 
freedcm. No statistically significant difference at the: ,05 level of cx>nfidence, 
using either the t value of F ratio in terms of an increase ir^ the total 
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Areas in which 
hypDtiieses were tasted 


Group Mean 

on 
Pre-test 


Group Mean 
on 

Post-test 


Mean 
Difference 


Percent 
Difference 


Increase in cell usage: 
Experimental Group 
Control Group 


50,2 
57.5 


60.8 
59.6 


+10.6 
2.1 


+21.11 
J + 3.6% 


Increase in categories used; 
Exptirimental Group 
Control Group 


10.6 
11.9 


12.3 
11.7 


+ 1.6 
- .2 


i 

! +15.1% ; 

- 1.7% ; 


Increase in Rtvilm III totals: 
ExpeM'imental Group 
CmLrol Group 


lO.S 
13.6 


26.1 
15.9 


+15.6 
+ 2.3 


• i 

r 

1 

+148.6% 
+ 16.9% 


Increase in Subnratrix I totals: 
EKpeiimental Group 
Control Group 


5,0 
5.8 


13.8 
6.7 


+ 8.8 
+ .9 


+176.0% 
+ 15.5% 



Figure 30 • Mean score differences bet\^02n the experin^tal and the control groups. 



number of categories used, was found betvc^ the two gxxxips* Uie null hypothesis 
was not rejecrari^ 
Tturd Null fiypothesis 

lYiere v^cxild be no dif ference in the i n crease in Realm III totals b^' thos e 
JQ"^^^^^^ the SSOR feedback betv^n the first cind second micro-teaching 
sessiai 3 arrl tiiose who did not receive f^ iidback at this tiJT^ > An examixation of 
the difference in the means betv^sen the tw groups revealed that the exferiittental 
gr^xip inc^roased its Realm III totals by 15,6 tallies (143.6% increase) vtiile 
the control gi'cup showed an increase of only 2,3 tallies (16,9% increase)* 
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The hypothesis was rejected by a significant t value of 2.9527 obtained 
for the difference between the twD groups, A t vcilue of 1.73 was required 
for significance at the .05 level of confidence for 19 degrees of freedom. 
The hypothesis was also rejected by a significant F ratio of 5.116 
obtained for group means difference. An F ratio of 4.45 was required 
for significance at the .05 level of coiifidence for 1 and 17 degrees 
of freedon. VJhen both the t value and F ratio v^e used, statistically 
significant differences were found at the .05 level between the two 
groups in reference to their increase in Realm III totals. This hypothesis 
was rejected by both the t value and an F ratio. 
Fourth Null Hypothesis 

There would be no difference in the increase in Sufamatrix I totals by 
those who received the SSOR feedback between the first and second ndcro- 
tpachinq sessiaiis and those who did not receive feedback at this time. An 
e,u\mination of the difference in the means between the tvro groups revealed 
that the experimental group increased its use of Sutinatrix I by 8.8 tallies 
(176.0% increase) , The hypothesis was rejected by a significant t value 
of 2.1166 obtained for the difference between the two groups. A t value 
of 1,73 was required for significance at the .05 level of confidence 
for 19 degrees of freedom. The hypothesis was also rejected by a significant 
F ratio of 5.144 obtained for group means difference. An F ratio of 
4.45 was required for significance at the .05 level of confidence for 
1 and 17 degrees of freedom. Statistically significant differences vere 
found at the .05 level using both the t value and F ratio betv^en the two 
groups in reference to the increase in Subniatrix I totals. This hypothesis 
was rejected by both the t-value and F-ratio scores. 
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Sunwwry 

Results for pilot studies designed to explore the utility and molding 
pcMer of the Social Science Observation Record have been reported . The SSOR • . 
nvay be used to help teachers change their b^>avior. Ihe SSOR is useful fbor 
des^cribing and interpreting expected classrocn events which do and do not 
occur. Ihe categories of the SSOR are perceived to be relevant to seoondary 
sichool student behaviors by social studies methods insbructors. Feedback in 
t(^^.-ms of SSOR data when provided to pre-service teachers tends to result in 
increases in tlie nuniDer of value cleurification statements expressed by their 
.'jtudcnts. An increase in t^Kise statements is valued by pre-service teachers. 

The studies reported here are little mor^ than a beginning. Unanswered 
questions abound. Are patterns of student behavior associated with different 
levels of thinking? Are different patterns of student, teacherr or student 
and teacher behaviors correlated with student learning, student achievement, 
and student percqptions? When teachers use indirect influence do they secure 
£:attems of student responses v*iich differ significantly fron those obtained 
when thfey use more direct influence? Do teachers \Ak> ask probing questions 
follow consistent and reliable strategies which can be identified and de- 
scribes! lyy the SSOR; if 30, can these behaviors be taught to teachers who do 
not use probing questions? What of teacher corditional moves, explanatory 
mTveii, structuring, and other strategies? Correlational and experijnental 
studies germane to these questions are still to be designed, conducted, and 
reportjCYl. 
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Chapter V 
DEVELOPING INTEHCODER ACa^EIWEWT 

An Introduction 

Initial analysis of data for the experiinental study reported in the 
preceding chapter indicated that the Social Science Observation Record has 
potential value for pre-service and in-service teacher education. Experimen- 
tal subjects, given the benefit of SSC« feedback, modified their behavior as 
teachers and secured consequential change in student behavior. Ihese changes 
v^e consistent with the self-reported objectives of both experijnental an3 
control group subjects. These changes were also in a direction valued by a 
selected groi^ of social studies niethods instructors \Ax> responded to a 
questionnaire. Futhermore, the change in student verbal beJiavior was con- 
gruent with results reported for a nc\tional survey of rardanly selected 
teacliers of social studies nethods (Tucker, 1972) . 

At this point, a decision had to be nade cc(nceming whether to proceed 
to engage in correlational and experiinental studies or to determine the 
degree to which SSOR data could be coded reliably. The decision was made 
that between-observer reliability warranted attention prior to further studies 
or to the reporting of studies already cotpleted. In order to report what had 
been done and to plan subsequent studies it was necessary to detemine if the 
realms, categories, and subnatrices were adequately defined and stated, thus 
convT.ying to others the concepts and rules which had been developed a«3 used 
for the collection, organization, and interpretation of data reported in the 
studies. 

Thf. historical developnent of the SSOR influenced this decision. The 
SSOR was slowly framed over a four -year period. It did not originate 



as a deliberate effort to develop an observation system. \*3rking as a post 
doctoral fellow at the University of Vfeishington, Casteel identified four in- 
terrogative modes of teacher behavior and organizai these into an instruction- 
al module for elementary teachers. This module was field tested in two in- 
service \NDrkshops conducted in the spring of 1969 in Seattle (Jaroliirek,1969) . 
In the winter quarter of 1970, Casteel used this module with nine University 
of Florida social studies interns who were doing peer-group teaching designed 
to increase their ability to lead class discussions. Wien the interns in- 
volved reported that they had aocidently learned to recognize ("code") the 
intent of a leader's questions and could do so repeatedly and accurately, the 
possibility of developing a feedback system dawned. By the svmrer quarter 
of 1970, the interrogative modes had been converted into categories of student 
statements likely to follcw different kinds of questions. At this point, all 
teacher talk was limited to one category. Ihe categoi'ies were organized to 
fonn a ten-by^ten matrix. (See Figure 31.) When this fotrot was used in 
conjunction with peer-group teaching and feedback, menters of a methods class 
coincidentally learned the system to the degree necessary to exercise control 
over a teacher's relative success or failure in obtaining instructional 
objectives. During the fall of 1970, Stahl became a partner. Together he 
and Casteel began to construct a nwdel of class discussion jjKXjrporating 
categories associated with student understanding and value clarification 
verbal behaviors. In subsequent quarters pre-service social studies teachers 
were asked to participate in peer-group teaching and were provided feedback 
in terms of the SSCB. In the J^ring of 1971, this experience with peer-group 
teachinci was used as a basis frcm which the sixteen categories were identi- 
fied. At this Lime, these categories were organized into four realms of 
assocLited beha\'iors. Sufcnatrices were identified and this recognition hogan 
to generate conjecture as to their meaning. Further work wit>) pre-seryice 
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Figure 31. Itie ten category SSOR matrix . (Source: 
J. Doyle Casteel, c.l970). 
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social studies teachers in the fall of 1971 led bo a systanatization of 
oquipnent includiiig data-collection sheets, scatter diagrams, and the SSOR 
n«trix. In the winter of 1972, the pre-post study reported in Chapter IV 
\>as conducted, and Casteel and Stahl found that they coded reliably; i.e,, 
toch could code the same lesson and collect the same data. In the Spring of 
1972, the experimental study reported earlier was conducted and the question- 
naire to selected social studies educators was mailed. An analysis of those 
questionnaixes returned led to changes in the Teacher-Centered Realm and to 
some alteration of category labels. The only change of substance made after 
this date was the creation of category 17, confusion, as a distinct non- 
verbal category. 

The foregoing chronology explains the problem. For more than two yecurs 
the SSOR was "teased "into shape as a model of discussion and as a feedback 
^nstruiTKjnt. EXiring this period categories had been identified, modified, 
rejected, and reconstructed. When the developers checked to determine if 
they wei'e coding discussion in the same vgay (reliably) , they consistently 
obtained reliability coefficient scores of 0.73 or better for categories and 
scores of 0.93 or better fox realjns using Scott's formula (Scott, 1955). 
They could not, however, estiiiate the degree to v*iich the definitions and 
ground rules of which they were consciously aware and reporting were indeed 
the definitions and rules they used to code data. A basic need, then, was 
to make certain that the SSOR as developed and understood by those who 
developed it could be conmmicated accurately to others. 

There was little point in proceeding ijimed lately to the planning of 
oorrelatinnal and experimental studies unless it could be determined that 
the systen could be coriniinicated to aiid learned by others. The SSOR needed 
to be tested for and, if n<*cessary, mxic reliable. Tvso reliability sturUes 
were planned and conducted to meet this objective. Subsequent soctxons of this 
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chaptar will describe what is meant by "between-coder reliability" and its 
siqnificance, oqolain how the reliability sttjd.les were orgemized and can- 
ducted, and report reliability data obtained frcm the two studies. 
Tt>e Nfc^anint) of Between-coder Reliability 

7\ny observation ijistrument — wtietlier a paper and pencil test or a 
category system — is intended to make available factual data which otherwise 
voild not be available for analysis or, if available, would not be assigned 
its warrantai significance. C^e the task of developing a reliable obsejr- 
vation system lias been acconplished , lx>th the occurrence and non-occurrence 
of exfxjctod events can be interpreted. 

iviplan (1964) refers to between-coder reliability by the terra inter- 
suhjoctivity . By this he means that as observers categorize and record data, 
they use tJie same subjective criteria consistently. Public criteria make 
subjective factors comon to everyone. 

The concept of inter subjectivity relates to -Jie SSOR. A number of 
observers observing the sar.ie class discussion would code and record the same 
SSOR data. What is occurring during the discussion would reveal itself to 
all observers engaged in the subjective act of corling student and teacher 
beiiaviors into one of se^'enteen categories for each three-second interval. 
If all obscj-vci-s are mined to see and code the same events, their inter- 
sutnect aqroerxint is evidence that the different observers are usinq the 
s<imD concept and ground r iles (factors cannon to all dbsej-vers) to code data. 
Tfiis comiionality then "testifies" to the objectivity of the instrument. The 
dcNjrGO to which they agree may be coiputed and callcsd their coefficient of 
betwoon-observer relial^ility. 

ivtwTc^n -observer reliability, as Kaplan explains it, assumes more method- 
ological importance than some have assigned it (Medley and Mitzel, 1^63) . If 
nbscr^ crs agree reliably, a classroom teacher who has corprehended CStopters 



II and III can interpret data collected by a trained coder. Further, the 
teacher may be confident that the data are c±> jective in the sense that his 
understanding, as he interprets data, and the understanding of the coder, as 
he coded the data, are sufficiently conparable to be judged reliable. For -che 
teacher interested in modifying either his verbal behavior (Realm II) or that 
of students (Realms I and III) , between-observer reliability offers assurance 
that observed changes in either h^s beliavior or that of his students are to 
he interpretoa as "true" changes in events observed rat than as coding 
errors. For the researcher, between-observer reliability develops confidence 
that data collected for analytical purposes are sufficiently df-^jective for 
framinci uifereixres. This allows him to analyze and interpret data for pur- 
poses otlier than those purposes for Which they were originally collected. Data 
about instructional iTehavior collected through systematic observation are 
diff ic ilt to collect (Medley and Mitzel, 1963) . They need not be discarded wlien 
original goals have been fulfilled. Hiese reasons help to explain why beta^jeen- 
coder agreesnent is iirportant in discussion about interaction analysis obser- 
vation systems. 

\kM Between ~r!oder Reliability V^s Developed 

Tw3 reliability studies were conducted by the investigators . toch 
study encorpassed eight sessions. The first study extended over a three-week 
period of time. The second was conci <n-:xated into two weeks. Ttk? procedures, 
materials, and sequence for both studies are reconstructed below in the form of 
a sunrviry for each session. 
Session 1 

'I'rainees were presented with a package of materials entitlocl "The 
Scx'-ial Science Dbservation Record: A Presentation Package." Ttiis packacje 
provided trainees with a one-page overview of the system and the followinq 

Er|c -94- 



BEST COPY AVAIIABLE 

elements: function chart, short definitions, data-collection sheets, scatter 
diagram, SSOR matrices, descriptions of suhiiatricos, and results of the pre- 
post study reported in Chapter IV. The intent was two-fold; (1) to help 
trainees understand the system tliey ware learning, and (2) to train them to 
transfer raw data to the SSOR matrix accurately. At the end of this session, 
trainees were provided with seventeen flash cards. Kach flash card had the 
number for a category printed on one side and the category label designated 
by that number on the reverse side. Trainees were instructed to study the 
flash cards and use the function chart found in the presentation packaqe in 
order to develop three skills: (1) given a category naane, they could report 
its number without pausing to think; (2) given a category number, they could 
report its name without pausing to think; and (3) given a categorial function, 
they could, on request, report intnediately either the correct category number 
or label. 'Jlio first skill was emphasized because SSOR data are collected by 
assigning nunters to behaviors occurring during three -second intervals. 
Session 2 

'I'rainees were divided into two-person teams. Hie team mentoers were 
instructed to drill one another using t}\o flash cards distrihuted at the end 
of the first session. Each team member practiced stating category nianbers far 
cateqory labels as these were presejited by his partner. When teams had become 
facile at this task, each trainee was presented with a twenty-five- page pack- 
age, entitled "Categories of the SSOR: Ejctenfled Definition" (Casteel and 
StjJil, 1972). This package included long definitions for each category with 
selected axanples of student or teacher stataiients for each category and 
<irovuid rules. (Ground rules are efforts to anticipate coding problems and to 
provide all coders with the same rules to follor.) Trainees read these defi- 
nitions. As questions arose, they v^sre answered by the trainers. At the 
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eand of the session trainees were asked to continue practicing with their 
^lash callus, studying the extended definitions, and memorizing the ground 
rules for coding. 
Session 3 

Dorirjg this session tra.inees revievwd pri<^ learnings and began to 
cocie pri .tad transcripts. Trainees divided themselves into pairs and drilled 
one another using flash cards (see session 2 above) . This lasted for approxi- 
UKR.ny rvjenty minutes and was intended to n^intain what had already been 
moiiorizod. 

After drilling, trainees were presented with one or two pages of printed 
transcripts of a class discussion. The coding rule followed was that each 
lino of print was to be coded once, liat, if a change of behavior occurred within 
a line, the line should be coded t^Ace or more to capture changes as they 
occurred. For the first transcripts, one trainee read a line orally, and a 
second trainee coded the line as ono (or more) category of the SSOR. Trainee? 
wore encouraqtM to,a!>d in fact did, raise questions when they could not agree 
as to wtiy a lino was coded in a particular way. Explanations were toade by 
referring to appropriate sections of "Categories of the SSOR: Extended Defi- 
nitions." As much as possible tho trainees were referred to the various de- 
finitions .and the function chart they possessed. 

In the next activity, trainees remained in their two-member teams. Each 
team coded by numbexs a pa^e of printed transcript in consultation with each 
other. (Trainees were not allowed to ase any SSOR materials.) At the ejxi 
of each pacTG the trainer, who served as the criterion person for all subsequent 
rolial^ility tests, read his codings. If differences existed between the trainees 
and the trair»er, tiie trainer explained how he had airived at his coding. Care 
was taken to explain that the objective of this exercise was for trainees to 
learn to "read" and eventually "hear" as the trainer read and heard, Dc±>ates 
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as to who was correct and v*jo was incorrect were avoided. 

After practicing in this fashion for approximately two hours, trednees 
ware handed a transcript (PTOl) and asked to code it independently as an ini- 
tial check on their ability to code discussions. Aftear coding, trainees used 
a scatter diagram and transferred their data into the SSOR matrix. Tbtal ca- 
tegory counts, realm counts, fuid subnatrioes counts were coipleted. When one 
of the trainers had checked the matrix for accuracy, each trainee could leave. 
The tliin! session ended. 
Session 4 

This session began with a review of numerical designations (flash card 
drill) and proceeded to a brief discussion of those categories found to cause 
coding difficulty in PTOi. Trainees were asked to pair off Into teams and were 
handed a printed transcript which liad already been codod by the trainers, P^ch 
team was asked to identify the basis that led the trainers to code the tran- 
script as it was coded using "Categories of the SSOR: Extended Definitions" 
and the function charts as reference. This required approximately one hour, 
anc] trainers refused to help teams for fear that any explanation might be 
perceived as defensive behavior. Next, trainees coded short sections of an- 
other printed transcript and periodically checked their coding against the 
coding of the criterion trainer. This lasted for approximately one hour. At 
this point trainees individually coded two transcripts designated as PT06 and 
PT07. Transcript PT06 stressed categories 1 through 10 .uid was constructed 
to diagnose trainee ability to code subject-centered behaviors reliably. 
Transcript PT07 stressed categories o throucjh 15 and was designed to 
determine trainee ability to code man-contered behaviors reliably. Again, the 
train€>es were allcwed to leave only after their completed matrices had been 
chcx:icod by the trainers. 
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Session 5 

Trainees were invited to paruse their reliability scores as they arrived, 
(Anonymity was provided by assigning a letter designation to each trainee 
known only to the trainee.) A brief discussion to clear up any coding problems 
followed with eq['hasis on the need to dbey the ground rules. The skill of 
timing was then introduced. Trainees first listened to an audiotape that 
Ixjepod every three seconds. Then thoy used data-collection sheets and wrote 
a letter of the alphabet e<ich timp they heard a beep. After practice in con- 
junction with the tape, trainees were asked to write a letter of the alphabet 
every three seconds using their own judgeinent as to the length of three 
seconds. Following two to three such practices all trainees were consistently 
coding between 19 and 22 letters per minute. This was considered an accept- 
able level of time by the research. (That timing developed so rapidly vos a 
pleasant surprise for the trainers as well as for the trainees. However, 
practice at timing with and \>athout the tape 'was reviewed at the beginning 
of each subsequent session.) This drill involved use of the same data-col- 
lection sheets used for coding video tapes later. 

At this point, video Lajjosware introduced. First, short segments varying 
in length from fifteen seconds to minutes vwsre played, and the criterion 
trainer called aloud the category of behavior occurring during each interval. 
After doing this several times, the video tape was rewund to the original 
segment coded by the trainer. Traincjes were instructed to code the tapes fol- 
lowing tMO additional rules: (1) once you''^ coderi an interval foaroet it. 
Even if you believe you've made an error don't attempt to correct it for this 
will confuse your timing and increase the cl-ianoes of errors in a nvmber of 
subsequent intervals, and (2) if more tiian one category of behavior occurs 
during an interval, code both in the order in v*iich they occur. 
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After giving these directions, the tape was started, and the trainer in- 
dicated that trainees were to begin coding when he called aloud the first ca- 
tegory he heard and recort3ed. The trainer and trainees then coded silently 
for one ndnute. After the one-^ninute coding episode was over, the trainer 
read aloud his codings by which trainees checked theirs. If discrepancies 
occurred, the tape was replayed with the trainer explaining the basis for his 
codii-iq. As with printed transcripts, discussions as to who \^s right and v*io 
was wrong were avoided as nuch as possible. The stress was on understanding 
the basis the trainer used for his codings. Five such practice segments 
occurrixi dm Lng this sossioa The practice segments continued for all re- 
maining session except the last. 

After a break, trainees first watched and then coded a disaission (VTOl 
for the first qx^oup and VT13 for t±ie secorxJ group of trainees.) They then 
transferred their data to the SSOR niatrix and totaled category, realm, and sub- 
matrix counts prior to leaving. This transfer consistently required thirty 
to forty-five ndnutes. 
Session 6 

Trainees reviewed timing as explained above. Trainees coded several 
seqiTr>nts of a video tape and checked the.ir coding for congruence with the 
t 'alner criterion as describt^d for .session 5. Again, the length of three 
practice segments varied from less than thirty seconds to more than two 
minutes. The criterion trainer frequently coded the entire segment orally 
while trainees watched and listened. At the end of this session trainees 
watched and coded a video taped discussion, built matrices, and left. 
Session 7 

As trainees arrived they were invited to view their reliability scores 
for the second video tape test. Timing was practiced. Training with taped 
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segments continued. A video-taped discussion was watched, then coded. After 
a break, a secorri video tape was watched and then coded. Trainees concluded 
this session by transferring the data for the two video tai:)es into separate 
matrices. Their conpleted matrices again served as their ticket to leave. 
Sessiort 8 

Trainees reviewed timing. Trainees watched a video tape. Trainee.- tlien 
coded this video tape. They transferred tlieir data into the SSOR matrix and 
took a short break until all had conpleted their matrix transfer. 

At this time trainees were told where their reliability scores were to 
be posted, asked to critique procedures used, and thanked for their cooperation. 
This ended the final session. 

The reconstruction of reliability training sessions describes the proce- 
dures, materials, and sequence used. Hopefully, the description is adequate 
to help the reader understand hew between-observer reliability training sessions 
are conducted. Scores for individual trainees and results of two studies Which 
examined between-observer reliability are reported next. 
Objectives for the Reliability Studies 

As described in Chapters Ilcind IT I, the SSOR has three major dimensions — 
reahns, categories, and subnatrices. The experiinental study reported in Chap- 
ter W involved hypotheses cast in terns of these dimensions. For this 
reason, both reliability studies vrere directed at training coders to develop 
specific criterion reliability scores for realms, categories, and subireitrices, 

Castcel served as the criterion coder for both sessions. This means that 
all reliability figures were corputed against his codings rather than using 
tiiQ standard practice of ccnputing between-observer reliability by pairing off 
the trainees. Ho coded each of the printed transcripts and video tajx>s at tl^e 
same tiinc as the trainees. His codings were used as the criterion against 
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vrtiich all trainees were oonpared. In order to maintain stabili ty as the 
criterion oiDserver, he ccnsistently cliecked his reliability by running inter- 
coder trials witli Stahl, He also checked his intra-ooder reliability by 
coding the same printed transcripts and tapes on different days. Scores of 
0.80 or better for realms, categories, and sutmatrices were obtained consis- 
tently using Scott's nethod to conpute between-observer reliability. Soott's 
method was also used to ooinpute the reliability tests for all trainees. 
Scott's method was selected becuase it appeared to be the conventional fomula 
used by persons such as Flanders (1960) , Ober, et. al. (1971) , and Bondi 
(1968). (See Figure 32 for an exanple of hew reliability was con|?uted using 
Scott's method as used by Ober, et. al. [1971).) 

Reliability scares VKre oon^ted for realms, categories, and sutmatrices. 
The typical practice founa was to determine bet^veen-observer reliability with 
reference to categories only. Failure to ocit^jute ether dimensions used to 
analyze and interpret behaviors has been criticized (Medley and Mitzel, 1963). 
The SSOR matrix contains four realms, seventeen categories, and twelve sub- 
matrices. Reliability scores were calcalated for eech of these. 

Different goals for the two studies were established. For the first 
study a mean reliability score of 0.60 for the last two video tapes was 
posited as being adequate. For the second study a mean reliability score of 
C.70 for the last two video tapes was posited as being adequate. The stan- 
dards were borrowed from Ober, et. al. (1971) . These authors suggest that 
a between-observer reliability score of 0.60 indicates sufficient mastery of a 
systan for it to be used by a classroon teacher who wished to collect and use 
data reflecting his own instruction, Ihey further suggest a reliability score 
of 0.70 for those who are serious about learning a system. The authors 
posited that a 0.70 was an acceptable minimal level for collecting SSOR datii 
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Tor research {Turposes. Hie 0.70 score on the second test was selected to 
dotemino if trainees could learn the SSOR to the degree necessary' for j^arti- 
cipation as trained coders in the collection of research data. Those stand- 
.Tjrls wpro ost-iblishod primarily so that the trainers could test and evaluate 
their matoxials. These staixiands wipjre not stressed with the trainees. A 
tt:;achtir neec? not be able to code data reliably to be able to use the SSOR as 
tr.inie of refexence for exandning his instructional behaviors. (See Chapter 

IV.) 

The First Stud y 

TIic first study vras conducted l^etween October 30 and Novaiilx>r 16, 1972, 
Participants in the study were in-.son,acc social studies teachers enrolled in 
the seocDndary social studies methods block in the College of Education, llni- 
versity of Florida. Students were invited to participate in a relialulity 
study in lieu of three wt>eks of participation and observation in local schools. 
Students were infonned t±i.-it their grades xvnuld not be affected if they chose 
to particii>ate in the stud v. Tivolve students volunteered for the study. Each 
stucient was randomly assigned a letter of the alphabet for identifying his 
papers. Tlieso letters wexo assigned to prevent any possible bias on the part 
of the trainers while taJDulating tJio results of the data. The criterion 
trainojT coded all printed transcripts ajr\ video tapes at the sane tiirie that 
trainees coded than. The second trainer handled the matrix data and conputed 
all the reliability scores. 

The twelve trainees coded antl reconled four printed transcripts for which 
roQlrn rol ic'^-ility was ccmputed. The mean score for each trainee for realms is 
shewn in Figure 33. For all reliability checks with printed transcripts, all 
twelve trainees attained the 0.60 standard with all twelve also having a mean 
score of 0.70 or better. The mean score for all the trainees on each of the 
four printed transcripts was 0 .76 or better. The mean score for the last two 
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Roalin Category Sutamatrix 



Subject 


PT 


VT 


Ibtal 


PT 


VT 


Ttotal 


W 




Total 


A 


.80 


.83 


.81 


.62 


.70 


.66 


.76 


.77 


.77 


B 


.80 


.82 


.81 


.58 


.64 


.61 


.76 


.70 


.73 


C 


.87 


.80 


.83 


.46 


.59 


.53 


.75 


.74 


.75 


D 


.85 


.67 


.76 


.65 


.55 


.60 


.74 


.60 


.67 


E 


.92 


.85 


.88 


.62 


.71 


.67 


.83 


.73 


.78 


F 


.82 


.71 


.77 


.58 


.54 


.56 


.74 


.71 


.72 


G 


.80 


.68 


.74 


.55 


.61 


.58 


.76 


.63 


.69 


H 


.82 


.81 


.82 


.53 


.50 


.52 


.82 


.79 


.80 


I 


.74 


.80 


,77 


.28 


.51 


.40 


.67 


.72 


.69 


J 


.73 


.79 


.76 


.51 


.66 


.58 


.67 


.77 


.72 


K 


.82 


.77 


.80 


.57 


.68 


.62 


.79 


.69 


.74 


L 


.74 


.78 


.76 


.54 


.64 


.57 


.71 


.74 


.72 




MEAN 


.81 


.78 


.79 


.54 


.61 


.58 


.75 


.71 


.73 



PT represents the mean of three printed transcript scores. 
Vr represents the mean of five video tape scores. 
Total represents the mean of all eight scores. 



Figure 33: The mean scores for the first reliability study*. (Using 
Scott's method for computing between-observer agreement.) 
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tests for each trainee revealed that all twelve trainees passed the 0.60 
standard witJi nine reaching or surpassing the 0.80 level. (See /^f^Jidix A 
for a report of all scores on all tests for each trainee.) No trainee was 
bclcw 0.60 on any of the tests for rea]jn reliability using printal transcripts. 

Four tests for realm reliability using video tapes vjere also taken. On 
the first check, seven of the eight trainees attending tlie session met the 
0.60 standard, five had reliability coefficients of 0.70 or better, and the 
mean for all trainees was 0.76. On the third tape, eleven trainees attaii>ed 
the 0.60 stardard. On the final tape, only one trainee fell below tine 0,60 
miniman. Mean scores for the last three checks tend to inprove fron 0.76 to 
0.78 to 0.80. yfnan realni-reliability scox-es for the last tvto video tapes v^e 
considered. Kleven trainees coded these two tapes. Only one trainee failed 
to meet the 0.60 standard as a inean score for the last two tapes. Six of ele- 
ven trainees had reliability coefficient secures of 0,80 or better. 

The mean .scores for all trainees for all printed transcripts and video 
tapes were ccnputed. Al]. twelve trainees met or surpassed the minimum 0.60 
score posited by the trainees. A.U twelve also bettered the 0.70 level with 
six meetincj the 0.80 score wheji the main of all scores was conputed. 

Category-reliability scores vv^re ccrputed for all trainees for all printed 
transcripts and videcD-tapt^ tests. Tlie mean score for each trainee for cate- 
gories is shown in Figure 33. mr all reliability checks with printed tjran- 
scripts, three of the twelve traineees attained the 0,60 stardard. Ttie range 
of mean scores for all trainees on each of the four test^ was frcm 0.44 to 0.60, 
For the first printed transcipts (PTOl) six of twelve trainees attained 0.60 
or better. For the second printed txanscript (PT06) five of eleven attained 
0.60 or better. For the third printed transcript only tv>flD of ten attained the 
0.60 standard, and the mean score for the tan dropped tr.i 0,44, For the fourth 
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print€3d transcript four of ten scored 0.60 or better with a vcean score for 
ten trainees of 0.55. Only four of the twelve trainees failed to reach the 
0.60 minimum on at least one of the four printed transcript tests while three 
of the trainees averaged 0.60 or better over all four tests. 

Attention to the four video tapes coded reveals t]iat two of eight trainees 
met the 0.60 standard on the first tape (VT13) . The mean for the eight on 
this tape was 0.56. Or the second tape (\T13) six of twelve trainees net or 
surpassed the 0.60 standard. mean score for the group was 0,59. Eight of 
eleven trainees met the 0.60 standard on the third tape (VT14) while ten 
reached the standard on the fourth tape (VT15) . The group n»ans for these two 
tapes were 0.61 and 0.67 respectively. Eight of the eleven undergraduate vol- 
unteers who took the last video-tape tests attained mean scares for these 
two tests of 0.60 or better. Tliree of the eight had a category-reliability 
moan score of 0.70 or higher on these two tests. It is noteworthy that ten 
of the eleven trainees did reach the 0.60 standard on the last videotape test. 

The mean category scores for all trainees for their combined printed tran- 
script and video-tape tests were canr^utvd. Five of the twelve trainees met ths 
0.60 standard posited by the trainers. Seven of the twelve failed to meet this 
mininuim standard when theix mean scores were conputed. 

Botween-coder reliability scores ^xe also conputed for suhmatrix agreement 
on all the printed transcript and video-taix.- tests. The mean for each trainee 
for subiBtrix-Tagreement scores is also shewn in Figure 33. For the four tests 
for subimtrix reliability using printcxa transcripts, each trainee reached the 
0.60 level at least once. All met or surpassed the 0.70 level at least once. 
On the first test (PTOl) eleven of the twelve bettered the 0.60 standard with 
a cnroup mean corputed at 0.75. Eleven of eleven coders met the 0.60 level on 
the second test (PT06) . On test three (VT07) seven of ten met the 0.60 

criterion. Nine of ten trainees bettered the 0,60 standard posited by the 
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trainers on test four (Vr06) . These nine also surpassed the 0.70 level. The 
group mean for the last printed transcript test vas figured to be at 0.78. 
All twelve coders averaged 0.60 or better on all their printed transcript 
tests with ton attaining a ii^n score of 0.70 or higher. 

When video tapes were made the focus of coding, the tendency on the part 
of tho coders was to code with greater agreement (higher reliability) . Six 
of Uio twelve trainees were present for ail four video-tape tests. On tiie 
first video tape (VT13) , seven of eight coders attained the 0.60 standard 
while comi^iling a group mean score of 0.70. The second test (Vrl3) found all 
twelve trainees coding reliability at the 0.60 level, with seven meeting a 0.70 
score. Ten of eleven trainees bettered the 0.60 standard on the last two 
video-tape tests (VT14 and VT15) . The group mean for each of these was 0.74 
and 0.70 respectively. An examination of the mean score of each trainee for 
the last twD video-tape tests reveals that eleven of the twelve met or sur- 
passed tht- minimum 0.60. standard, with ten reaching the 0.70 level. All twelve 
of tJio trainees averaged 0.60 or better on the four video-tape tests. 

Tho twelve undergraduate coders met or exceeded the criterion, 0.60, 
established for subtiatrix reliability. All twelve achieved this task on both 
printed transcripts and video-tape replay tests. 

In summary, of the twelve undergraduate trainees, twelve met the 0.60 
standard on their mean realm scores, five met the criterion for categories, 
and twelve met the criterion for sutana trices. The result of this first attempt 
at training cxders to code reliably in^Ucated that, with between eighteen and 
tvsenty-four hours of training, a participant could learn to code classroom 
Ix^haviors at the 0.60 level. This study gave the trainers confidence that 
the system itself could be comiunicated accurately to others to the degree 
that they could code with a high level of agreement with the trainers. How- 
ever, one of the problems reported by t}ie volunteer coders was the need for 



more qrounri niles to be included in the materials entitled "Categories of the 
SSOR: l^ictended Definitions." Several trainees reported that the trainers ap- 
poi-cntly had not specified all the ground rules they wei-e using when they coded 
data. A second suggestion was that the short practice segments of from fif- 
teen seconds to two minutes be eiTployod more often. A thini suggestion was 
made with regard to conductincj future studios. It often took up to forty-five 
itdnutes to transfer the transcript or tape data to the matrix; a considerable 
Ix>rtion of each of the last four session was spent in building matrices. The 
trainees points out that if a nethod was available to bypass this tine con- 
suminci task, more of the trainincj session time could be used for training 
coders. While the trainers did make adjustments in the materials and proce- 
dures in response to tJie first two student -coder requests, they did not solve 
the problem concerning tma spent tiransf erring data to the matrix. 

Ttie Second Studv 
— — — 1 .1 j>.., 

The second study vns conducted between January 15 and 26, 1973, iten 
persons volunteered to participate in the study. Hiese ten included two 
ijn.-.s..>r\-ic:.-> .icK-'ial r.tudics tc^av^lk^n^, u-ro social stixlios interns, two graduate 
assistants in the Department of Secondary Education, one graduate student, 
one science teacher, one social science teacher, and one undergraduate Early 
ChildlxxDd Education student. The training sessions were conducted at P. K. 
Yonqo Laboratory Scnool and were held four nights a week for two consecutive 
weeks. Again letter codes were given to each student. The two trainers 
fulfilleci the same role as they had in the earlier stidy. Retween-coder reli- 
ability tests for ixith printed transcripts and video tapes are discussed below. 

Roaljn reliability using printed transcripts was tested three times during 
the sc>cond study. Because of various personal problems, only five of the ten 
trainees coded all tJiree printed transcripts. The iT»an score for each trainee 
for realm is shewn in Figure 34. For all reliability checks with printed 
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-79 


.80 

• WW 


*71 


68 
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.69 


80 
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67 


71 


B 


.66 


.68 

# W W 


67 
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84 


45 


41 


59 


54 


56 


c 


• 88 


.89 


.88 

• WW 


74 


68 

• wU 


70 


• Ow 


77 


79 


D 


.74 


.80 


.78 


.69 


.64 


•66 


.72 


.66 


.68 




QQ 


• 7d 


• 78 


• 64 


• 65 


/re 

•65 


OA 


• 62 




F 


.87 


• 82 


.84 


.70 


.65 


.67 


.86 


•73 


.78 


V) 




"J A 


•711 

.75 


• 71 


.61 


• 65 




• 64 


.71 


H 


.80 


.75 


.76 


• 53 


.64 


.62 


.81 


.60 


.64 


I 


.83 


.70 


.73 


.58 


.65 


.64 


.81 


.60 


.65 


J 


.93 


.90 


.91 


.91 


.85 


•85 


.90 


•81 




5? 


.82 


.78 


.79 


.65 


.65 


.65 


.80 


.66 


.70 



W represents the mean of three printed txanscript scores. 
W represents the mean of five video tape scores. 



Ttotal represents the mean of 2lL1 eic^t scores. 



Figure 34 5 The mean scores for the second reliability study. (Using Scott's 
method for canputing betvreen-^server agreement.) (See Appendix 
for detailed data on these reliability scores.) 
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tran.scripts, all ten trainees attained the earlier 0.60 standard with nine of 
the ten attaining a mean score of 0.70 or better. The mean scxDx*e for all 
trainees on each of the three printed transcript tests was 0.71 or better. Si.x 
v>t tiit^ sovon trainees wJio pairticipatai in the first printt>d transcript tost 
pa;-5sod tlK» mu\imum 0.60 standard with five of tlie seven nx2etinfg or surpassing 
tlie 0.70 level. The mean, for all trainee's was 0.79. Five of six ti-ainoes 
attaintxl tiie 0.60 level on tix? second tost with four passing th3 0.70 level. 
A m<\in of 0.71 w:is camputod for the second test. Eight of eight trainees 
jjiirixissc^d tht- 0.70 level with seven of tlx? eight having scores of 0.80 or 
higher on Uiis last printed transcript test. The mean score for the eight 
tramtvs on tlie diird test was 0.87, 

A similar pattern was revealed when reliability scores for realrns were 
Liliulatod \^iior\ five video tafies wero us-.-d. Six of the eight trainees taKing 
t!>' t urst tost using video tapes .tiet the 0,70 standard posited ]y/ the trainers, 
witJi thoir meaji sooro being 0.74, Five of eight met tiie 0.70 standard on the 
SL.'Oontl video-tape test. On the third test, eight of nine trainees passed the 
0.7G suindard with slk of the trainees sur}jassing the 0.80 level. The mocin 
•)f tho nine scores for thir. test was 0.81. Seven of nine and nine of nine 
trauicvs met or pissed the 0.70 stardard on the fourth and fifth text respec- 
l ively. On tlie fianl test, tlir(.»e trainees reached the 0.90 level. The mean 
or tlv^ nint-' trainees for the last video-tat;>e test was 0.83. All trainees 
nviorirxl thv' 0.70 standard on roaljn reliability for vidfo taix:s. The moan 
n-alni st-c^r'j for their last two video tapes vfcre examijied for consistency. Of 
t!o ten tr.unco.s all ten liad reliability mf^an scores of 0.80 or better. 

v'' r.i: 'ut.it ion of t hi.- mc\in sa>r<-'s for all traineos for all printcxi tran- 
r:; ;in.l ^'uion tajji^-s n.vcali.x: itvit. luno oi" the ten train->\s sui'ioassixJ the 
t).'.'') r>(^i:j.i.u\i Wit.) lour tTK^.'tin'i or surivissinsJ the O.BO level. Only one of the 
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ten txainees failed to meet the 0.70 level when the mean of all his scores 
was ooinputed, 

• Between-observer agreement in reference to categories v«as oonputed for 

three printed transcripts and five video tapes. The mean scores for each 

* 

trainee for category reliability is shown in Figure 34. Of the ten trainees, 
five ware present for all three printed transcript tests while four trainees 
coded only one printed transcript. Three of seven iret the 0.70 standi for 
the first printed transcript (PTOl) , three of six for tXie second (PT02) , and 
four of seven for the third transcript (PT06) . The group mean soores for 
these three tests ware 0.73, 0.59, and 0,63 respectively. The difference in 
mean soores airong the three tests is partially explainable in that one trainee 
dropped from a 0.63 first-test score to a 0.11 score on the second, and a 
0.27 score on the third test. Six of the ten trainees met the 0.70 mininwm 
standard at least once on the three printed tremscripts. Five of ten averaged 
0.70 or better for transcript tests. 

With regard to the five video-tape tests, the results were more positive, 
il^jain, half of the trainees were present for all five tape tests. The first 
video-tape (VTOl) test found only one of eight trainees meeting the 0.70 stan- 
dard. The second tape (VT02) found none of the eight trainees meeting the 
minimum standard. In both the first two tape tests the mean of the group wess 
0.55. The mean of the third video-tape test rose to 0.63 with two of nine 
trainees meeting the 0.70 level. Five of nine trainees reached or bettered the 
0.70 standaiti on tests four (VT04) and five (VT05) . The means for these tests were 
0.72 and 0.71 respectively. An examination of the last two video tapes tJ»t each 

m 

trainee ctxiod reveals that six of Uie ten averaged better tlian 0.70. When 
the mean score for all video-tape tests was ociT|)leted, only one trainee met 
the 0.70 standard with a 0.85 average score. However, eight of the ten sur- 
passed the 0.60 mark. 
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An exaiidnation of the mean of all trainees for all tests taken reveals 
that only two trainees averaged 0*70 or better ♦ Nine of ten averaged better 
thiin 0.60 on all their tests. The group mean for eight tests was 0,65» 

Moan subnatrix reliability scx)rea are also shovvn iii Figure 34* Only 
five of ten particiioants coded all three printed txanscripts* Six of th^ 
seven trainees cxxiinq the first transcript (PTOl) bettered the 0.70 st-andaru 
while canpiiing a group mcMn score of 0.78 • Four of six and eight or eight nK^t 
or surpassed the 0.70 lovel on the second and third tests respectively. Nine 
trainees Ix^ttered the 0.70 level on the second and tlii.ird tests. All ten trainees 
ix^ttercxi Uio 0.70 s^^-^ndard at least once on the printed transcript tests vshile 
eight of the ton train^^t^^s averaged 0.80 or higher over all three tests. 

When video tapes vs^re first introduced, none of the eight trainees pre5;ent 
attaincxi a score of 0.70 or higher. On the second video--tape test {VY02) only 
one of the eight trainees n>et thc^ established staixJard. The group mean for 
Uiesc* t\\0 t.osts was 0.55 and 0.56 respectively. A ix)ticeable improvaiient vgas 
seen in the third test when six of nine trainees bettered the 0.70 criterion 
score*. On the final tv^ tests four of nine and six of nine met tl-^e minimum 
stanilarci of 0.70. The group mean for e^ach of tlie last three video-tape tesiis 
was aix^vo this standard with respective scores of 0.72, 0.72, and 0.73. VVhile 
all ttm trainees met the 0.70 standard at least once on video--tape tests, only 
thrvx: had attamod avi::irafjO scores on video tapes above this level. 

The n)ean scores for all tramt^es on the suhmatrix reliability tests were 
ccmputod. Five of tht* ton trainees met or surioassod the O.vn mininum star^rd 
Si»t by the trainers with nine of ten liettering the 0.60 score. 

In sunrviry, of the ton volunteer i>articipants in this study nine met t>ie 

0.70 standard on their mean realin scores, six iDet the criterion level for 

catcxjories, and six met ttyot criterion for subnf^ trices. The results of this 

study to determine if trainees could attain a score of 0.70 indicate Uiat, with 
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BEST COPH MAILABLE 

between eighteen and twenty-four hours of training , sane trainees could meet 
the suggested criterion level for coding data for research purposes. These 
results suggest tliat the SSOR can be learned by others to the degree necessary 
for research purposes. However, in spite of modifications in the materials 
and procedures as suggested by participants in the first study, category reli- 
ability remained a slew process for trainees. The participants themselves 
could not identify any reason except the time factor of twenty-four hours as 
being the cause of this slow growth in between-observer agreement. The trainers 
did oomputo one interesting fact that may have contributed to the outcome of 
the study. While the total tijue of the training sessions viras twenty-four 
hours, the actual time spent training participants was fourteen hoLirs. More 
than sLx hours alone was spent transferring data fron the eight tests into 
matrices. The trainers were unable to remedy this situation. Ttie partici- 
pants were positive towaxd the training sessions, the procedures used, and 
their own efforts. The suggestions they made for further mcxiifications re- 
quired minor changes in the materials. The alterations have since been ccnpleted. 
In Conclusion 

The conclusion that trainees can learn the SSOR and daiionstrate relatively 
high levels of betv^^een-coder agreement is warranted. Ttie reliability of an 
obsen'er is his score as cotputed according to the mathonatical formula sug- 
gested by Scott (1955). Another formula would probably \iave resulted in soine- 
what different scores. Trainees \A\o scored below 0.60 in the first study or 
0.70 in the second study did not fail. Neither did those who met these cri- 
teria pass a test of corpetence. Their scores represent a level of agreement 
on a particular test with a criterion coder taking the same test at the same 
time. The criterion scores served primarily as goals toward which the trainers 
v«Drked and assessed their efforts, nvitorials, and training procedures. Between- 
CJbserver agreement does represent one way of detGrmining whether efforts to 
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convey cwncepts and ideas thrcxigh speaking and writing are understood in the 
same sense and may be applied in the same sense and in the same manner by 
an audience with whan cane wished to cGnminicate. Not every person \Ax> 
volunteers for training can be assured that he will meet even the 0.60 
level witixm the time limits specified in these studies. 

The Social Science Observation Record (SSOR) can be learned in 
varying degrees by pre-service and in-service teachers. ClassroGm teachers 
do not need to be reliable coders in order to understand and use the SSOR 
as a descriptive, analytical or modification tool. A teacher can use the 
SSOR as a model of discussion or as a systematic framework to look at his 
own behavior without in-dept±i training. However, the research reported in this 
monograph and elsewhere indicates that teachers are quite different teachers 
when they have some kncwledge of an observation system than vAien they 
have no such knowledge. 

Thus, the teacher who has knowledge of the SSOR possesses a frame of 
reference that he can use to examine and modify his behaviors and those 
of his students. 
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